← Все заказы

Data Engineer Tester - Healthcare Data & AI Validation - Remote (Philadelphia, P

NTT DATA

13 ч назад

Текст заказа

Req ID: 398012
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Data Engineer Tester - Healthcare Data & AI Validation - Remote to join our team in Philadelphia, Pennsylvania (US-PA), United States (US).
Data Engineer Tester (2 Positions) – Healthcare Data & AI Validation
Industry: Healthcare / Life Sciences / Biotechnology
Position Overview
We are seeking two experienced Data Engineer Testers to support the quality assurance, data integrity, and regulatory validation of an enterprise-scale medical data ingestion and automation platform.
These individuals will be responsible for designing and executing comprehensive testing strategies across complex ETL pipelines, large-scale data processing environments, and AI-driven data mapping solutions. The platform processes substantial volumes of structured and unstructured healthcare data, including clinical records, pathology reports, and other medical datasets.
The successful candidates will validate data ingestion, transformation, mapping accuracy, semantic alignment, and overall pipeline performance. A key component of the role will involve testing and validating outputs generated by Machine Learning models, Large Language Models (LLMs), and Natural Language Processing (NLP) technologies to ensure data accuracy and alignment with established healthcare standards and medical ontologies.
Candidates should bring a combination of hands-on data engineering, automated testing, big data quality assurance, and healthcare or life sciences domain experience.
Key Responsibilities
Data Pipeline & ETL Testing
Design, develop, and execute automated testing frameworks to validate complex ETL pipelines and large-scale data transformations.
Verify data accuracy, completeness, consistency, and integrity across ingestion, processing, transformation, and output stages.
Develop SQL and Python-based scripts to perform data reconciliation, validation, and automated quality checks.
Test data processing workflows across distributed environments and large-scale platforms.
Identify, document, and troubleshoot data discrepancies, transformation defects, and pipeline failures.
AI-Driven Data Mapping & Model Validation
Develop testing strategies to validate automated data mapping and semantic alignment generated by Machine Learning models and LLMs.
Verify AI-generated mapping outputs against established healthcare data standards, medical terminologies, and biomedical ontologies.
Evaluate mapping accuracy, precision, consistency, and completeness across diverse clinical and medical datasets.
Develop test datasets and validation benchmarks to assess model performance and identify mapping errors or inconsistencies.
Collaborate with Data Scientists and Machine Learning Engineers to investigate defects and improve model validation processes.
Performance, Load & Scalability Testing
Conduct performance, stress, and load testing across high-volume data ingestion and processing pipelines.
Benchmark data throughput, processing speed, resource utilization, and system responsiveness under varying workloads.
Validate distributed data processing performance across technologies such as PySpark, Databricks, Snowflake, and AWS EMR.
Assess pipeline performance in environments utilizing specialized AI hardware, including NVIDIA GPUs and Google TPUs.
Identify performance bottlenecks and collaborate with engineering teams to improve processing efficiency and scalability.
Unstructured Data & NLP Validation
Develop and execute test cases for NLP and Named Entity Recognition (NER) models processing unstructured clinical information.
Validate the accuracy of extracted medical entities, terminology, relationships, and clinical information from medical records and pathology reports.
Test entity recognition, classification, normalization, and semantic extraction outputs.
Verify that extracted information is correctly mapped to standardized medical terminologies and data structures.
Regulatory Compliance & Data Quality Assurance
Validate data lineage, traceability, audit logging, and security controls throughout the data processing lifecycle.
Ensure testing practices support applicable healthcare and life sciences regulatory and privacy requirements, including HIPAA, GDPR, and relevant GxP requirements.
Verify data handling, access controls, and documentation requirements within regulated healthcare data environments.
Maintain test documentation, execution evidence, defect records, and validation results to support auditability and compliance.
Test Management & Defect Resolution
Develop and maintain test plans, test cases, test scripts, and automated regression suites.
Track testing progress, defects, and resolution activities using Jira or Azure DevOps.
Collaborate with Data Engineers, Data Scientists, Machine Learning Engineers, and Business Analysts to resolve technical issues.
Participate in Agile development activities, including sprint planning, testing reviews, defect triage, and release readiness assessments.
Required Qualifications
3–5 years of professional experience in Data Testing, Data Engineering, Big Data Quality Assurance, or Software Testing focused on data-intensive applications.
1–2+ years of experience within Healthcare, Life Sciences, Biotechnology, Pharmaceutical, or related regulated data environments.
Hands-on experience testing complex ETL pipelines, data transformations, and large-scale data processing workflows.
Strong SQL and Python programming skills for data validation, reconciliation, and test automation.
Experience validating structured and unstructured datasets and identifying data quality issues.
Understanding of automated data testing, regression testing, performance testing, and defect management.
Familiarity with healthcare data standards, clinical data models, and medical terminology.
Experience working with technical teams in Agile or enterprise software delivery environments.
Technical Skills & Qualifications
Data Engineering & Big Data Platforms
Strong SQL and Python programming capabilities.
Experience with PySpark, Databricks, Snowflake, and/or AWS EMR.
Understanding of distributed data processing, ETL architecture, data ingestion, and transformation workflows.
Experience testing large datasets across cloud-based data platforms.
Automated Testing & Data Validation
Hands-on experience with data quality and testing frameworks such as:
Great Expectations
dbt Testing
PyTest
Automated SQL-based validation frameworks
Git-based CI/CD testing and validation pipelines
Experience developing automated data reconciliation, regression, and quality assurance scripts.
AI/ML & Infrastructure Testing
Working knowledge of Machine Learning, LLMs, NLP, and AI-assisted data mapping.
Understanding of model output validation, semantic mapping, entity extraction, and data classification.
Familiarity with GPU/TPU-accelerated computing environments, including monitoring, troubleshooting, and performance testing of associated data pipelines.
Exposure to NVIDIA GPU infrastructure, Google TPUs, or comparable AI computing environments is an asset.
Healthcare Data Standards & Medical Ontologies
Working knowledge of healthcare data standards and medical terminology, including:
HL7 and FHIR
OMOP Common Data Model (OMOP CDM)
SNOMED CT
LOINC
ICD-10
Test Management & Development Tools
Experience with Jira and/or Azure DevOps for test management, requirements traceability, defect tracking, and reporting.
Familiarity with Git, CI/CD workflows, and automated test execution.
Education
Bachelor's degree in Computer Science, Software Engineering, Data Engineering, Bioinformatics, Health Informatics, or a related technical discipline.
Pay Transparency
Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting pay range

Похожие заказы