company

Full-Stack Software Engineer with Data Pipeline Expertise

Neural SolutionsAnnapolis Junction
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Required Skills & ExperienceStrong background in data wrangling and dataflow (discovery, mining, cleaning, exploration, enrichment, validation). Proficiency in JSON and JSON Schemas (or equivalent). Demonstrated data modeling skills. Experience with NoSQL databases including Elasticsearch, MongoDB, Redis, and graph databases. Familiarity with dataflow tools, particularly Apache NiFi. Extensive experience in Python or Java (both are preferred). Experience with generative AI for code and data transformation. Proficient with Git for version control and Maven for build automation.

About the job

We are seeking a passionate Full-Stack Software Engineer focused on data pipelines. In this dynamic position, you will play a key role in the development of ingest pipelines, scalable REST APIs, and facilitate comprehensive data exploration and insights. Our platform is designed for large-scale data ingestion, complex querying, and interactive data analysis. While your primary emphasis will be on the data-pipeline layer, collaboration with various teams is essential to ensure seamless functionality and optimal performance. If you are eager to enhance team processes and tools for quicker integration of new data sources, we want to hear from you!

Key Responsibilities

  • Design and implement robust data-processing workflows.

  • Oversee the entire data-processing lifecycle, including collection, discovery, analysis, cleaning, modeling, transformation, enrichment, and validation.

  • Create and uphold data models and JSON Schemas to ensure data integrity and consistency.

  • Work collaboratively with analysts and engineers to fulfill data requirements.

  • Optimize data storage and retrieval in Elasticsearch, Dgraph, MongoDB, and Redis.

  • Manage dataflow orchestration using Apache NiFi.

  • Mentor colleagues on best practices in data processing and software engineering.

  • Utilize AI platforms for hybrid automated/manual data transformation, code generation, and schema management.

  • Collaborate with analysts, product owners, and engineers to ensure operational solutions meet needs.

  • Propose and execute process improvements for more efficient delivery of new data sources.

About Neural Solutions

Neural Solutions is at the forefront of data engineering, providing innovative solutions that empower businesses to harness the full potential of their data. We foster a collaborative environment where technology and creativity merge to produce cutting-edge solutions. Join us in transforming the way organizations utilize their data.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.