TechBiz Global logoTechBiz Global logo

Data Engineer at TechBiz Global | Remote

TechBiz GlobalRemote job
Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Experience

Qualifications

Key Responsibilities:Design, develop, and maintain data ingestion pipelines utilizing Kafka Connect and Debezium for both real-time and batch data integration. Ingest data from MySQL and PostgreSQL databases into AWS S3, Google Cloud Storage (GCS), and BigQuery. Implement best practices in data modeling, schema evolution, and efficient partitioning within the Bronze Layer. Ensure the reliability, scalability, and monitoring of Kafka Connect clusters and connectors. Collaborate with cross-functional teams to comprehend source systems and downstream data requirements. Optimize data ingestion processes for enhanced performance and cost efficiency. Contribute to automation and deployment scripts utilizing Python and cloud-native tools. Stay abreast of emerging data lake technologies such as Apache Hudi or Apache Iceberg. Required Skills and Qualifications:5+ years of practical experience as a Data Engineer or in a similar role. Proven expertise with Apache Kafka and Kafka Connect (both sink and source connectors). Experience with Debezium for change data capture (CDC) from relational databases. Strong proficiency in MySQL and PostgreSQL. Hands-on experience with AWS S3, Google Cloud Platform (GCP) BigQuery, and GCS. Proficient in Python for automation, data manipulation, and scripting.

About the job

Join TechBiz Global, a leader in providing recruitment services to top-tier clients, as we seek a talented Data Engineer to become a pivotal part of one of our esteemed client's teams. This role offers an exciting opportunity for personal and professional growth in a cutting-edge environment.

About TechBiz Global

TechBiz Global specializes in delivering top-notch recruitment services to leading companies across various sectors. Our mission is to connect exceptional talent with outstanding opportunities, fostering innovation and growth in the tech industry.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.