Full Stack Data Engineer

Ford Motor Company is advancing mobility through enterprise technology and connected vehicle solutions. The Full Stack Data Engineer will design and maintain scalable data pipelines, build GCP data platforms, implement governance and security, optimize performance, and translate business requirements into reliable data solutions.

Responsibilities:

• Data Pipeline Architect & Builder: Spearhead the design, development, and maintenance of scalable data ingestion and curation pipelines from diverse sources. Ensure data is standardized, high-quality, and optimized for analytical use. Leverage cutting-edge tools and technologies, including Python, SQL, and DBT/Data form, to build robust and efficient data pipelines
• End-to-End Integration Expert: Utilize your full-stack skills to contribute to seamless end-to-end development, ensuring smooth and reliable data flow from source to insight
• GCP Data Solutions Leader: Leverage your deep expertise in GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.) to build and manage data platforms that not only meet but exceed business needs and expectations
• Data Governance & Security Champion: Implement and manage robust data governance policies, access controls, and security best practices, fully utilizing GCP's native security features to protect sensitive data
• Data Workflow Orchestrator: Employ Astronomer and Terraform for efficient data workflow management and cloud infrastructure provisioning, championing best practices in Infrastructure as a Code (IaaC)
• Performance Optimization Driver: Continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions, ensuring optimal resource utilization and cost-effectiveness
• Collaborative Innovator: Collaborate effectively with data architects, application architects, service owners, and cross-functional teams to define and promote best practices, design patterns, and frameworks for cloud data engineering
• Automation & Reliability Advocate: Proactively automate data platform processes to enhance reliability, improve data quality, minimize manual intervention, and drive operational efficiency
• Effective Communicator: Clearly and transparently communicate complex technical decisions to both technical and non-technical stakeholders, fostering understanding and alignment
• Continuous Learner: Stay ahead of the curve by continuously learning about industry trends and emerging technologies, proactively identifying opportunities to improve our data platform and enhance our capabilities
• Business Impact Translator: Translate complex business requirements into optimized data asset designs and efficient code, ensuring that our data solutions directly contribute to business goals
• Documentation & Knowledge Sharer: Develop comprehensive documentation for data engineering processes, promoting knowledge sharing, facilitating collaboration, and ensuring long-term system maintainability

Requirements:

• Bachelor's degree or foreign equivalent in Computer Engineering, Electrical Engineering, Information Technology, Electronic Engineering or a related field and 4 years of experience in the job offered or a related occupation
• 2 years of experience with each of the following skills is required: 1. Engineering real-time streaming pipelines using Kafka, OpenShift, and Dataflow to ingest high-speed telematics bursts from connected vehicle networks, ensuring seamless reliability for time-sensitive alerts and low-latency decision-making
• 1. Leveraging Java and Spring Boot frameworks to stream, decode and ingest connected vehicle data, enabling ultra-fast throughput processing and near real-time availability
• 1. Architecting robust database solutions using Spanner, PostgreSQL, and BigQuery to provide scalable, high-availability storage, advanced querying, and analytics capabilities for large-scale datasets
• 1. Directing end-to-end GCP cloud data projects, leveraging Apache Beam, Spring Boot, Airflow, BigQuery, Cloud Storage, and Cloud Build to orchestrate streamlined pipelines to data ingestion, transformation, and automated deployments
• 1. Developing scalable, high-volume Connected vehicle data streaming platforms with OpenShift and Spring Boot frameworks, implementing resilient data handling, fault-tolerant mechanisms, and performance optimizations under heavy computational loads
• Note, this is a purely telecommuting/work-from-home position whereby the employee may reside anywhere within the U.S
• Candidates for positions with Ford Motor Company must be legally authorized to work in the United States