Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...Our Program and Construction Management division has an need for a Construction Project Manager to oversee a large building renovation and site work project located in Montauk, Long Island. Come join our team! We are looking to build services and capabilities...
...in Correctional Health Care has a Full Time opening for a Nurse Practitioner in our Regional Office in Hopkinton, MA ! At VitalCore... ...first-hand how VitalCore Health Strategies promotes a positive work environment that is based on respect and appreciation of the...
...Using the Synergy Model, the Clinical Nurse Specialist (CNS): Acts within the nurse-patient, nurse-nurse, and nurse-system spheres. Facilitates a multi-disciplinary and collaborative approach in the provision of health care, within a specialty area. Is responsible for...
...Ascent Audiology & Hearing , located in Fort Lauderdale, Florida, is a well-established private practice clinic dedicated to providing... ...driven and caring providers. The Hearing Aid Specialist position at Ascent Audiology & Hearing entails a range of responsibilities...
...work experience in the subject area(s) taught (ACCSC) Must possess a minimum of two years full-time experience as a registered sonographer in the professional sonography field with experience in ABD, OB/GYN, and/or general sonography. (JRC-DMS) OR Must possess a minimum...