Senior Test Engineer

Summary

As a Senior Test Engineer, you will join our Platform team working on AI-powered products and their integration with the cloud-hosted FINEOS AdminSuite. As part of a cross-functional scrum team operating within a SAFe framework, you will test AI services, validate their integration with the core platform, and expand automated test coverage across the AI product portfolio.

You will be responsible for testing AI/ML-driven features end-to-end - from model service outputs through to their consumption within the FINEOS Suite - ensuring accuracy, reliability, consistency, and compliance. Testing will combine automation and manual techniques aligned to best practices and the test pyramid. You will use AI-powered engineering tools to improve your own productivity and testing workflows.

Successful candidates will be strong in Python with Java experience a plus, have a solid quality engineering mindset, and be keen to work in a collaborative, agile environment tackling the unique testing challenges that AI-powered systems present.

Responsibilities (Other duties may be assigned.)

• Work within a Scrum team to ensure successful delivery, based on definition of done for features and user stories.
• Attend daily Scrum meetings, regular retrospectives, sprint demonstrations, and PI planning events.
• Participate and contribute to regular innovation-focused cycles.
• Participate within the wider Test Community of Practice and attend regular discussions and presentations related to QA.
• Test analysis and design based on feature documents, technical specifications, and solution designs.
• Test AI services for functional accuracy, reliability, edge cases, response consistency, and failure handling.
• Validate the integration between AI services and the FINEOS AdminSuite platform, ensuring data flows correctly and features behave as expected end-to-end.
• Address AI-specific testing challenges including hallucinations, prompt variations, inconsistent outputs, safety, privacy, and edge-case behaviour.
• Design and execute test cases covering functional, integration, regression, end-to-end, exploratory, and non-functional testing.
• Develop and maintain automated tests using existing frameworks, extending them as needed to support new AI-driven capabilities.
• Integrate automated tests into CI/CD pipelines, owning the test stages and ensuring reliable, repeatable execution.
• Perform manual testing using a mix of scripted and exploratory approaches where automation is not yet practical.
• Test web services and APIs (REST), validating request/response contracts, error handling, and performance characteristics.
• Troubleshoot defects and perform root cause analysis using application logs, metrics, and observability tooling, and recommend solutions or workarounds.
• Produce quality metrics including test coverage, defect reports, release readiness, and execution status.
• Use AI-powered tools to accelerate test case generation, automation development, test data creation, defect analysis, and documentation.
• Liaise with other Scrum Teams, Product Owners, Release Train Engineers, and architects to ensure successful delivery.
• Provide mentoring and guidance to team members.
• Identify and implement improvements that enhance the test process and improve overall quality assurance practices.
• Contribute to evolving strategies via inspect and adapt, communities of practice, and knowledge-sharing sessions.
• Support release validation, regression testing, and production defect verification.

Education and/or Experience

• Minimum 5+ years’ experience as a Test Engineer working with web-based applications, APIs, and integrations.
• Experience working in Agile methodologies, preferably SAFe.
• Relevant third-level qualification (BS/MS) or equivalent commercial experience.
• Strong programming skills - Python preferred, Java desirable. Solid understanding of object-oriented design principles is essential regardless of language.
• Experience with enterprise-scale applications and the full software development lifecycle.

Knowledge, Skills, and Abilities

• Strong test analysis, test design, and troubleshooting skills, particularly for complex and non-deterministic systems.
• Understanding of AI/ML concepts sufficient to test AI-powered features effectively - awareness of how LLMs, document extraction, and ML models behave in production.
• Understanding of AI-specific testing challenges including hallucinations, prompt sensitivity, non-deterministic outputs, safety, and privacy concerns.
• Ability to design test strategies for systems where outputs are probabilistic rather than deterministic.
• Ability to critically review and validate AI-generated test cases, automation code, and documentation.
• Excellent written and verbal communication skills.
• Ability to multitask, use initiative, and work to tight deadlines.
• Ability to work independently with minimal supervision and take ownership of critical deliverables.
• Strong estimation, analytical, and problem-solving skills.
• Passion for continuously learning and adopting emerging AI technologies in software quality engineering.
• Insurance or financial services domain experience is an advantage.

Technical Skills

• Automated test design and development experience, preferably in Python and/or Java.
• Experience with UI automation frameworks such as Selenium WebDriver or Playwright.
• Experience testing REST APIs using Postman, RestAssured, or similar tools.
• Experience with test frameworks such as pytest, pytest-bdd, JUnit, TestNG, or Cucumber.
• Experience with BDD testing approaches (e.g. pytest-bdd, Cucumber) is desirable.
• Active ownership of CI/CD pipeline test stages using tools such as Jenkins, Gradle, or similar.
• Experience using AI-powered tools to improve engineering productivity in day-to-day testing work.
• Experience with Git and modern code versioning practices.
• Practical knowledge of relational databases (e.g. Oracle, SQL Server) and ability to write SQL queries for test verification.
• Basic knowledge of NoSQL databases and data storage patterns is desirable.
• General understanding of AWS cloud services and cloud-based testing strategies.
• Familiarity with observability and monitoring tooling is desirable - New Relic for dashboarding, and AWS CloudWatch including writing CloudWatch Logs Insights queries.
• Familiarity with containerisation (Docker) is desirable.
• Experience with code quality tools such as SonarQube is desirable.
• Multi-platform familiarity (Linux/Windows).
• Experience with non-functional testing approaches including load and performance testing (using Locust, JMeter, or similar tools) is desirable.
• Experience testing enterprise SaaS products is desirable.
• ISTQB Foundation Level Certificate in Software Testing (or equivalent qualification) is desirable.
• AWS certification (e.g. Cloud Practitioner, Solutions Architect Associate) is desirable.

Language Skills

• Ability to speak the English language proficiently, both verbally and in writing.

Travel Requirements

• This position does not require travel.

Location

• Remote - India

Work Environment

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

• Employee works primarily in a home office environment.
• The home office must be a well-defined work area, separate from normal domestic activity and complete with all essential technology including, but not limited to; separate phone, scanner, printer, computer, etc. as required in order to effectively perform their duties.

Work Requirements

• Compliance with all relevant FINEOS Global policies and procedures related to Quality, Security, Safety, Business Continuity, and Environmental systems.
• Must be legally eligible to work in the country in which you are hired.

FINEOS is an Equal Opportunity Employer. FINEOS does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.