Data Engineer (43440)

I am looking for a Data Engineer who will design and build scalable data pipelines for processing unstructured data. You will integrate AI/ML components such as NLP and LLM-based extraction and work closely with cross-functional teams. I expect strong experience with Python, Databricks, and large-scale data processing.

🚀 Project
- build data pipelines to ingest, process, and enrich unstructured data (documents, text, images)
- integrate AI/ML components (NLP, LLM-based extraction, embeddings) into data workflows
- collaborate with testing to define scenarios and validate output quality
- work with ontology engineering to deliver enriched data into the semantic layer
- optimize pipelines for scalability in Databricks environment
- document data flows, transformations, and enrichment logic

🎯 Skills
- 4+ years of experience in data engineering with focus on AI/ML-driven data processing
- practical experience processing unstructured data at scale
- experience with generative AI / LLM-based extraction or classification
- strong Python skills
- experience with Databricks and/or Apache Spark

💡 Nice to have
- experience with vector databases and embedding-based retrieval