Data Engineer Job at Qode, Pennsylvania

OFpxQTZTUlp0L2t6R2VuejZUY1hDS0pWS3c9PQ==
  • Qode
  • Pennsylvania

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

CITGO Petroleum Corporation

Financial Analyst-Financial Reporting Job at CITGO Petroleum Corporation

 ...Summary Assist in the preparation of all (i) quarterly and annual financial statements and annual audit reports with accompanying footnotes...  ...may be assigned. Here are the incentives we offer: Remote Work options available for eligible positions Options are... 

MixMob

Lead Game Designer Job at MixMob

 ...We are growing like mad and are looking to hire a talented Lead Game Designer. We believe that all good things are wild and free, so we operate 100% remote. 100% independently. You have demonstrable skills in organization, process & structure, and are interested in pursuing... 

CACI

Benefits Financial Analyst Job at CACI

Benefits Financial Analyst Location Reston, VA : Benefits Financial Analyst Job Category: Human Resources Time Type: Full time Minimum Clearance...  ...and effective benefits administration. This position is remote for a local candidate in the DC Metro Area. Responsibilities... 

US Federal Aviation Administration

Human Resources Specialist (Staffing ) Job at US Federal Aviation Administration

Human Resources Specialist (Staffing ) Location El Segundo, CA : Duties Responsibilities FV-F duties: As an entry-level HR Specialist under the close direction of more experienced HR Professionals performs the following duties: Advise and consult with managers,... 

TalentOla

Clinical Data Analyst Job at TalentOla

 ...Role: Clinical Data Analyst, Location: Remote Experience: 10 years What this job is about (in simple words) This role is for a clinical professional (doctor, nurse, or similar) who is very comfortable with medical codes and SQL . Your...