Data Engineering Senior Associate
DTCC · Hyderabad, India · 10d ago
Are you ready to make an impact at DTCC?
Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.
Pay and Benefits:
- Competitive compensation, including base pay and annual incentive
- Comprehensive health and life insurance and well-being benefits, based on location
- Pension / Retirement benefits
- Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
- DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).
The Impact you will have in this role:
The Development family is responsible for creating, designing, deploying, and supporting applications, programs, and software solutions. May include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities related to software products used internally or externally on product platforms supported by the firm. The software development process requires in-depth subject matter expertise in existing and emerging development methodologies, tools, and programming languages. Software Developers work closely with business partners and / or external clients in defining requirements and implementing solutions. The Software Engineering role specializes in planning, documenting technical requirements, designing, developing, and testing all software systems and applications for the firm. Works closely with architects, product managers, project management, and end-users in the development and enhancement of existing software systems and applications, proposing and recommending solutions that solve complex business problems.
- Design, build, and maintain scalable enterprise data pipelines and data products using Snowflake, dbt, Python, and Apache Airflow.
- Develop and optimize data models following Medallion Architecture (Bronze, Silver, Gold) principles to support analytics, reporting, and downstream data consumption.
- Implement and manage Apache Iceberg tables, ensuring efficient data storage, partitioning, lifecycle management, and performance optimization.
- Build and maintain complex Airflow DAGs to orchestrate large-scale batch and data processing workflows with high reliability and observability.
- Develop advanced SQL transformations and data quality frameworks to ensure data accuracy, consistency, and governance across platforms.
- Optimize Snowflake workloads by monitoring query performance, warehouse sizing, clustering strategies, and credit consumption to improve cost efficiency.
- Collaborate with data architects, platform teams, and business stakeholders to translate data requirements into scalable technical solutions.
- Develop reusable dbt models, macros, tests, and documentation while promoting data engineering best practices.
- Utilize PySpark for large-scale data processing and transformation activities where distributed computing is required.
- Implement infrastructure-as-code solutions using Terraform to automate provisioning and management of cloud data platform resources.
- Support CI/CD implementation for data engineering solutions using Git-based workflows, automated testing, and deployment pipelines.
- Leverage Snowflake Cortex and AI-powered capabilities to enable intelligent data processing, enrichment, and analytical use cases.
- Containerize and deploy data engineering applications using Docker and modern DevOps practices.
- Conduct performance tuning, troubleshooting, and root cause analysis across data pipelines, orchestration workflows, and storage layers.
- Ensure adherence to data governance, security, compliance, and operational standards across enterprise data platforms.
- Mentor junior team members and contribute to architecture reviews, code reviews, and engineering best practices.
- Strong hands-on experience in Snowflake, dbt, Airflow, Python, and Advanced SQL.
- Expertise in dimensional data modeling, star/snowflake schemas, and Medallion Architecture.
- Experience with Apache Iceberg table optimization, compaction, partition evolution, and query performance tuning.
- Knowledge of data orchestration, monitoring, lineage, and observability frameworks.
- Familiarity with cloud-native data platforms, CI/CD pipelines, DevOps practices, and Infrastructure as Code.
- Strong analytical, problem-solving, and stakeholder management skills.
- Own medium-to-large data engineering initiatives with minimal supervision.
- Drive technical design discussions and recommend scalable architecture solutions.
- Balance performance, cost, reliability, and maintainability across data platform implementations.
- Participate in production support and continuously improve platform stability and operational excellence.
Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.