Qualifications
Qualifications:Proven experience in building and operating highly available distributed systems for data extraction, ingestion, and processing of large datasets.A minimum of 5 years of experience delivering data engineering solutions on cloud platforms.At least 5 years of experience implementing modern designs using one or more cloud solutions/platforms (AWS, Azure, GCP).Advanced proficiency with at least one ETL/Data Orchestration technology (such as Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion).Experience with cloud-based data warehousing and data lake technologies like Snowflake, Redshift, or Databricks.A minimum of 5 years of experience with SQL or NoSQL databases (including PostgreSQL, MySQL, SQL Server, Oracle, Aurora, Presto, BigQuery).Expertise in SQL, database design/structure, and data architecture (including star, snowflake schemas, and de/normalized designs).At least 5 years of experience with one programming language such as Python, Java, or Scala.
About the job
At CapTech, our Data Engineering consultants empower clients to construct and manage sophisticated data systems that integrate information from diverse sources, facilitating informed decision-making. We specialize in developing data pipelines and preparing datasets for utilization by data scientists, analysts, and various data systems. Our passion lies in solving complex challenges and crafting innovative solutions for our clients. Our Cloud Data Engineers harness cloud infrastructure to deliver immediate value and ensure scalability for the future. We thrive in a collaborative environment, fostering ample opportunities to learn from and share insights with other developers, architects, and our clients.
The Value You Deliver (What You’ll Do):
- Act as a trusted advisor to clients, providing guidance on best practices, methodologies, and technologies for implementing data engineering solutions.
- Design, develop, and sustain modern data pipelines to deliver optimal solutions utilizing suitable cloud technologies.
- Collaborate with product owners and business stakeholders to analyze customer requirements and deliver maintainable and sustainable engineered solutions.
- Provide technical leadership and work collaboratively across teams to ensure that the overall technical solution aligns with customer needs.
- Stay abreast of the latest cloud technologies, patterns, and methodologies; share knowledge by clearly communicating results and ideas to key stakeholders.
About CapTech Consulting
CapTech is an award-winning consulting firm dedicated to helping clients realize their potential through the transformative power of technology. Our team is passionate about the work we do and the impactful results we achieve for our clients. Founded on a commitment to fostering strong, enduring relationships, today we partner with clients that include Fortune 100 companies, mid-sized enterprises, and government agencies across the nation.