Data Engineer (39459)

Do you thrive in transforming data infrastructure? I'm seeking a skilled Data Engineer to migrate complex data assets into Databricks Unity Catalog, ensuring compliance, scalability, and enhanced security. Your strong Python, Spark, and SQL background will be essential, alongside cloud experience (preferably Azure) and orchestration tools like Airflow. I value a software engineering mindset, CI/CD familiarity, and hands-on Docker use. Blockchain or Delta Lake knowledge is a bonus. If you're ready to lead impactful migrations and collaborate across teams, let me know.

🚀 Project
- migrating existing tables, pipelines, permissions, and related components to Databricks Unity Catalog
- ensuring the transition to Databricks as a Service (DBXaaS), including configuration and management
- ensuring the migration covers all relevant environments and assets while adhering to governance policies
- improving data security, manageability, and scalability of the data infrastructure
- collaborating with other teams to ensure smooth integration and proper implementation of the migration

🎯 Skills
- advanced Python knowledge and software engineering skills
- experience from a software engineering role or software engineering education
- proven experience with Apache Spark and SQL for data engineering and analysis
- experience with Databricks for data ingestion and transformation
- experience with data orchestration tools like Apache Airflow
- hands-on experience with one or more cloud services (Azure - preferred, AWS, GCP)
- proficiency in RDBMS/NoSQL data stores and appropriate use cases
- experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging
- familiarity with containerization tools such as Docker
- solid understanding of the software development life cycle
- strong communication, interpersonal and presentation skills

💡 Nice to have
- understanding of blockchain technologies and data structures
- knowledge of cryptography and its application in blockchain
- experience with blockchain indexing is a plus
- familiarity with Delta Lake and data warehousing concepts
- Kubernetes