V
Data & AI Engineer
Virtual Vocations Inc
1 hour ago
Full-time
On-site
New York City, New York, United States
Seeking a full-time remote Data & AI Engineer, this position will manage the development and modernization of enterprise data pipelines and automation frameworks, focusing on leveraging Databricks and cloud-native architectures to enhance data capabilities across the organization.
Key Responsibilities
Design, develop, and maintain scalable data ingestion and transformation pipelines using Databricks, PySpark, Python, and SQL Implement automation frameworks to eliminate manual processes and streamline engineering workflows Collaborate with cross-functional teams to translate business requirements into effective engineering solutions
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical discipline 2+ years of hands-on experience in data engineering or related technical roles Strong proficiency in Python, SQL, and PySpark for data processing and automation Experience developing ETL/ELT pipelines and working with cloud-based data platforms Familiarity with modern data architecture concepts and data integration formats
Design, develop, and maintain scalable data ingestion and transformation pipelines using Databricks, PySpark, Python, and SQL Implement automation frameworks to eliminate manual processes and streamline engineering workflows Collaborate with cross-functional teams to translate business requirements into effective engineering solutions
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical discipline 2+ years of hands-on experience in data engineering or related technical roles Strong proficiency in Python, SQL, and PySpark for data processing and automation Experience developing ETL/ELT pipelines and working with cloud-based data platforms Familiarity with modern data architecture concepts and data integration formats