ProArch
ProArch
ProArch is a technology consulting and digital engineering company helping organizations modernize operations, manage cloud infrastructure, use data and artificial intelligence, and strengthen cybersecurity. Its services span software development, AI consulting, quality assurance, infrastructure management, governance, risk and compliance, and operational technology. As a Microsoft Gold Partner, ProArch develops tailored technology solutions for sectors including consulting, healthcare, manufacturing, credit unions, and power generation, connecting technology strategy with practical business goals.

AWS Glue Data Pipeline Tester (Hybrid Contract, India)

Test AWS Glue data pipelines and file-processing integrations for quality, reconciliation, resiliency, security, and operational readiness. The role covers AWS workflow validation, monitoring, recovery, and end-to-end testing.

Description

  • Establish and verify data-quality rules for completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, business-rule compliance, and schema or metadata consistency.
  • Execute functional tests across data pipeline components.
  • Conduct end-to-end integration testing.
  • Validate processed data against expected results.
  • Reconcile source and target data to identify discrepancies.
  • Run parallel tests against legacy interfaces.
  • Perform regression testing after changes.
  • Test system-level integrations across connected components.
  • Assist with user acceptance testing.
  • Test invalid inputs and anticipated failure conditions.
  • Evaluate exception handling and error paths.
  • Measure performance under expected and high-volume workloads.
  • Assess pipeline scalability.
  • Verify restart and recovery procedures.
  • Test failover behavior and system resilience.
  • Validate security controls and access permissions.
  • Conduct production smoke tests.
  • Verify operational processes and monitoring coverage.

Requirements

  • Hands-on experience with AWS Glue Jobs.
  • Hands-on experience with AWS Glue Workflows.
  • Experience working with Amazon S3.
  • Experience working with Amazon CloudWatch.
  • Experience working with AWS IAM.
  • Experience working with Amazon EventBridge.
  • Experience working with AWS Lambda.
  • Experience working with Amazon SNS.
  • Experience working with Amazon SQS.
  • Experience working with AWS Secrets Manager.
  • Experience working with AWS Step Functions.
  • Experience working with AWS KMS.
  • Ability to inspect AWS Console configurations, job parameters, logs, metrics, and execution history.
  • Experience testing data pipelines and file-processing interfaces.
  • Strong understanding of inbound and outbound data-file processing and pipeline workflows.
  • Experience testing inbound and outbound file transfers through S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints, including authentication, connectivity, retries, timeouts, and delivery verification.

Related Jobs