Data Engineer Job at Qode, Pennsylvania

OFpxQTZTUlp0L2t6R2VuejZUY1hDS0pWS3c9PQ==
  • Qode
  • Pennsylvania

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

Vitaly Health

Locum Tenens OB/GYN Physician Job at Vitaly Health

 ...Job Title: Locum Tenens OB/GYN Physician Location: North Carolina Position Overview: Our team is looking for an OB/GYN Physician to join our Medical Center in North Carolina on a 1-month locum tenens basis, beginning in late November 2024, with the possibility... 

Port City Air

Aircraft Arrival Representative Job at Port City Air

 ...to detail. Valid Drivers License. Reliable transportation. Subject to routine drug and alcohol screenings. Must pass the FAA and Homeland Security background checks as well as complete a pre-employment drug screening. PHYSICAL REQUIREMENTS Must... 

Nashville Public Radio

Digital Marketing Manager Job at Nashville Public Radio

 ...to preserving and amplifying the legacies of performing arts communities through inclusive digital storytelling. Were looking for a strategic, hands-on Digital Marketing Manager to help bring our platformsCurtainConnect and our archival servicesto life for the communities... 

Manpower

Forklift Operator Job at Manpower

 ...training programs available * Paid referral program Stop your job search and apply today! Share this job with friends and family and earn dollars with every successful hire. ManpowerGroup recognizes the importance of providing an accessible and barrier-free environment... 

Work With Your Handz

Executive Skilled Trades Recruiter Job at Work With Your Handz

 ...Executive Skilled Trades Recruiter - Sourcing Expert Needed! Are you a dynamic, experienced recruiter passionate about connecting top talent with exceptional opportunities? Do you excel at sourcing candidates, particularly for specialized or leadership positions within...