Senior Test Analyst

Mandatory Qualifications:
  • At least seven (7) years of experience within the last ten (10) years working as a Test Analyst with large organizations, leading or participating in the technical implementation of software/systems/applications automating complex business processes, which must include all of the following:
    • Assessment of scope and tasks pertaining to technical testing.
    • Planning technical testing tasks.
    • Mapping of various business, user, and system requirements to test cases.
    • Leading and/or working within cross-functional teams that include business subject matter experts, application architects, developers, and testers.
    • Demonstrable experience in preparing test plans, test cases, and documenting test results.
    • Demonstrable experience with regression testing and adjusting test plans for periodic maintenance releases.
  • At least seven (7) years of experience within the last ten (10) years producing testing deliverables, such as: (CalSTRS may request deliverable related work samples during the Interview phase)
    • Test strategies
    • Test plans
    • Test cases
    • Transition plans
  • Traceability matrices
  • At least three (5) years of experience performing data reporting and validation activities (writing SQL queries).
  • At least five (5) years of experience within the last ten (10) years implementing automated testing on projects with large organizations, leading or participating in the technical implementation of software/systems/applications performing all of the following:
    • Implement new automated tests based on existing manual test cases and business requirements.
    • Propose and create shared libraries of test steps that can be integrated into cross-application test suites.
    • Assist in the development of new tools to speed the adoption of automated testing organization-wide and maximize re-use and commonality across teams.
    • Partner with other teams to evangelize and support automated regression testing practices.
    • Using Java, Python, Shell Scripting, or another language as part of test automation.
    • Shorten application regression testing windows via automation.
    • Write automation tests to improve the test coverage.
Desirable Qualifications:
  • One (1) or more years of experience working as a Test Analyst leading or participating in the technical implementation of pension/retirement-related software development projects.
  • Two (2) or more years of experience performing parallel testing of mainframe applications along with web-based applications.
  • Three (3) or more years of experience working with requirement elicitation methodologies, documenting business use cases, business rules, functional and non-functional requirements.
  • Three (3) or more years of experience using Test Application Lifecycle Management tools such as HP ALM, or Jama to map functional and non-functional requirements, design specifications to test cases and defects, and provide full traceability for projects.
  • A Bachelor’s Degree in Computer Science, Computer Engineering, Management Information Systems, or related fields from an accredited or government-sanctioned college/university.
  • Two (2) or more years of experience in Job Control Language (JCL).
  • Two (2) or more years reviewing or developing Natural/Adabas code.
Tasks/Deliverables:
  • Support Test Activities
  • Ensure application meets the business, operational, and technology requirements.
  • Analyze use cases, design specifications and engage stakeholders to elicit detailed information about the application under test to gain in-depth knowledge of the application.
  • Contribute to the creation of a test strategy.
  • Create technical documentation and review with stakeholders.
  • Build tests to verify application functionality and to identify defects.
  • Write code to create/modify scripts and programs to automate tests.
  • Manage version control of test scripts/harnesses.
  • Execute manual and automated tests.
  • Analyze tests towards making them more efficient.
  • Create automated tools using technologies such as VBScript, Javascript that aid in testing the functionality and making the process more efficient.
  • Document defects and assist with defect tracking tools used by CalSTRS staff.
  • Monitor defects, participate in daily triage meetings, report status to management, and communicate information related to releases to stakeholders in a timely manner.
  • Perform regression test activities during periodic maintenance releases.
  • Conduct problem and impact assessment, gap analysis, process mapping, root-cause analysis, risk analysis, and requirements elicitation.
  • Resolve issues by using strong analytical and technical skills to address a variety of system-related problems.
  • Identify and clarify requirements using basic conceptual and logical process and data modeling tools and techniques.
  • Discuss proposed solutions with customers in a proactive/consultative fashion.
    • Examples of anticipated deliverables include, but are not limited to, all of the following:
    • Test Case / Test Scenario documentation
    • Test Results / Test Summary documentation
  • Traceability matrices
    Support Development of Testing Deliverables
    Develop and document testing strategies for the various phases of testing.
    Assist with the development and documentation of test cases.
    Perform defect management.
    Review vendor project deliverables.
  • Examples of anticipated deliverables include, but are not limited to, all of the following:
    Test Strategy
    Test Plans
    Test Cases
    Test Results / Test Summary
    Defect Reports
Education:

A Bachelor’s Degree in Computer Science, Computer Engineering, Management Information Systems, or related fields from an accredited or government-sanctioned college/university.