Senior Data Engineer – AWS Data Lake & Pipeline Architecture
Job Overview
Summary We are seeking a Data Engineer to support the development of a Data Intelligence Platform. This role focuses on data modeling, data services, data pipelines, and cloud-based data infrastructure for reporting, analytics, and data science.
General information This Data Engineer will support data-related operations across a broader Data Intelligence Platform team.
Job Description
The environment includes AWS-based infrastructure and a mix of structured and unstructured data sources. Tasks and Deliverables - Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions.
- Create data models from scratch using strong SQL fundamentals. - Write and optimize in-application SQL statements. - Ensure the performance, security, and availability of databases. - Prepare documentation and technical specifications.
- Handle database procedures such as upgrades, backups, recovery, and migration. - Profile server resource usage and optimize configurations as necessary. - Design, build, and automate the deployment of data pipelines and applications.
- Integrate data from on-premise databases and external data sources using REST APIs and harvesting tools. - Collaborate with business units and data science teams on data access, transformation, processing, and reporting needs.
- Support implementation, technical issues, and training related to the data lake ecosystem. - Work with the team to manage AWS resources, including EMR and ECS clusters. - Support provisioning, monitoring, configuration, and maintenance of AWS tools.
- Evaluate and promote new cloud technologies that improve capabilities and lower operating costs. - Support automation efforts using Infrastructure as Code with Terraform and CI/CD tools such as Jenkins.
Key Responsibilities
- Summary We are seeking a Data Engineer to support the development of a Data Intelligence Platform.
- General information This Data Engineer will support data-related operations across a broader Data Intelligence Platform team.
- The work includes building and consuming web services, integrating search technologies, supporting personalization and recommendation engines, and applying data engineering best practices across the platform.
- The role spans cloud-based data architecture, database performance, pipeline automation, and support for data scientists, researchers, and internal business units.
- Tasks and Deliverables - Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions.
- Design, build, and automate the deployment of data pipelines and applications.
- Support implementation, technical issues, and training related to the data lake ecosystem.
- Work with the team to manage AWS resources, including EMR and ECS clusters.
Required Skills and Qualifications
- Required experience - 7-9 years of experience designing and developing cloud-based data models, ETL pipelines, and infrastructure.
- Experience working with both structured and unstructured data.
- Experience optimizing large, complex SQL statements.
- Knowledge of best practices for relational databases.
- Experience configuring database engines and orchestrating clusters.
- Experience with Spark, Glue, EMR, and Apache Kafka or AWS Kinesis.
- Experience with version control tools such as Git or Subversion.
- Experience using automated build systems and CI/CD workflows.
USA Jobs Today role summary
Role Summary
Senior Data Engineer – AWS Data Lake & Pipeline Architecture at Toptal is a remote United States position and is listed as Full Time.
Summary We are seeking a Data Engineer to support the development of a Data Intelligence Platform.
Review the employer's original description and official application page before applying; USA Jobs Today organizes source-supported details for readability without changing stated requirements.
Application Checklist
- Review the stated qualifications, including: Required experience - 7-9 years of experience designing and developing cloud-based data models, ETL pipelines, and infrastructure. Experience working with both structured and unstructured data.
- Confirm that the official application page still lists the role as open.
- Verify the work location and any United States eligibility or work-authorization requirements.
- Tailor your resume to the responsibilities and qualifications stated by Toptal.
- Apply only through the official link shown on this page and never pay USA Jobs Today to submit an application.
Original job information is provided by the hiring organization or listed source. USA Jobs Today organizes source-supported details for readability without inventing salary, benefits, qualifications, sponsorship, or remote eligibility.
Work Location and Schedule
This role is listed as Remote USA with location information shown as Remote USA. The employment type is Full Time.
About the Company
Toptal is the organization connected with this listing. USA Jobs Today displays this opportunity for job discovery only, so applicants should verify company details, application instructions, and eligibility on the official employer website.
Application Notes
This job was reviewed for USA-only relevance. Always apply through the official employer website, review the full job details carefully, and avoid sharing sensitive personal or payment information outside a trusted application process.
Report this job if it looks expired, suspicious, inaccurate, or unsafe.More USA job search options
Related resources for this job seeker
Use these links to browse more USA jobs, compare related categories, prepare your resume, and read USA job search guidance before applying.