Lead Data Engineer Job at Nava Software Solutions LLC, Houston, TX

MGpFMFM0Tm5zcUk4VFI5bW9FcE85V245VXc9PQ==
  • Nava Software Solutions LLC
  • Houston, TX

Job Description

NAVA Software solutions is looking for a Lead Data Engineer

Details:

Lead Data Engineer
Location: Houston TX - 4 days onsite
Duration: Full time /Direct Hire

As a Lead Data Engineer you will:

  • Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.
  • Work within cloud environments like AWS or Azure to leverage services including but not limited to EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to support operational and analytical applications, ensuring data quality and accessibility.
  • Utilize ETL tools and frameworks (e.g., Apache Airflow, Talend) to automate data workflows, ensuring efficient data integration and timely availability of data for analytics.
  • Collaborate closely with data scientists, providing the data infrastructure and tools needed for complex analytical models, leveraging Python or R for data processing scripts.
  • Ensure compliance with data governance and security policies, implementing best practices in data encryption, masking, and access controls within a cloud environment.
  • Monitor and troubleshoot data pipelines and databases for performance issues, applying tuning techniques to optimize data access and throughput.
  • Stay abreast of emerging technologies and methodologies in data engineering, advocating for and implementing improvements to the data ecosystem.

What We Need From You

  • Bachelor's Degree computer science, MIS, or other business discipline and 10+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req or
  • Master's Degree computer science, MIS, or other business discipline and 5+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures Req
  • Expertise in developing ETL/ELT workflows
  • Comprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native data offerings
  • Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage
  • Strong experience in AWS and Azure cloud services, with hands-on experience in integrating cloud storage and compute services with Databricks
  • Proficient in SQL and programming languages relevant to data engineering (Python, Java, Scala)
  • Hands on RDBMS experience (data modeling, analysis, programming, stored procedures)
  • Familiarity with machine learning model deployment and management practices is a plus
  • Strong communication skills, capable of collaborating effectively across technical and non-technical teams
  • AWS Certified Solution Architect Preferred
  • Databricks Certified Associate Developer for Apache Spark Preferred
  • Azure Data Engineer Associate Preferred
  • or other relevant certifications. Preferred

Job Tags

Full time,

Similar Jobs

Pyramid Consulting, Inc

Power Platform Developer Job at Pyramid Consulting, Inc

 ...degree in computer science, information technology, or a related field (or equivalent experience). Extensive experience working with Microsoft 365 and Azure solutions, particularly within a U.S. Federal agency context. ~5+ years SharePoint development and maintenance... 

Apace, formerly Region V Services

Health Care Coordinator - LPN or RN Job at Apace, formerly Region V Services

 ...JOB SUMMARY Under the direct supervision of the Director of Nursing Education, the Health Care Coordinator is responsible for the training and certification of direct care staff in the area of medication aide, CPR, and other approved activities and training as assigned... 

K2 Staffing DFW

Sales Representative - Entry Level Job at K2 Staffing DFW

 ...Full-Time Entry-Level Sales Position with Training in Houston, TX Are you ready to launch your career in sales and make your mark? K2 is looking for driven, energetic, and ambitious individuals to join our Nashville team as Entry-Level Sales Representatives.... 

Kontos Foods Inc

Graphic Artist Job at Kontos Foods Inc

 ...to our customers. We believe that great design is key to sharing our family history as bakers...  ...Job Summary: Were seeking a talented Graphic Artist to elevate our visual identity and...  ...with cross-functional teams. Time Management: Ability to prioritize tasks,... 

Actalent

Sales Trainee Job at Actalent

 ..., and 401(k)~20 days paid time off (accrued per year)~ Cell phone allowance after first year ~ Employee discounts ~ Tuition reimbursement program ~ Monthly wellness calls Our Culture The Actalent experience is one of high standards for professional and...