Data Engineer

You will join our growing technical department and you’ll help shape and develop a more mature team and be surrounded by talented professionals who are passionate about honing their craft and delivering world-class experiences. We are passionate about developing high performing teams in tandem with deliverables while wearing many hats with our sleeves rolled up.  We collaborate and help each other and we do what needs to be done to deliver on our commitments and deliver amazing products to our customers and users. Remote work is ok.

Our organization leverages data as a strategic asset to drive innovation, improve business processes, and enhance decision-making. As a Data Engineer, you will play a critical role in designing, building, and maintaining scalable data infrastructure that empowers our teams to extract actionable insights and unlock the value of data.

Responsibilities:
 

• Design, build, and maintain scalable and efficient data pipelines, ensuring the ingestion, transformation, and storage of structured and unstructured data from various sources.
• Collaborate closely with data scientists, analysts, and stakeholders to understand data requirements and implement data-driven solutions that align with business objectives.
• Develop and implement data integration processes, including data extraction, transformation, and loading (ETL) workflows, utilizing tools such as Apache Spark, Apache Kafka, or similar frameworks.
• Perform data wrangling, cleansing, and validation to ensure data accuracy, integrity, and consistency.
• Optimize data pipelines for performance, scalability, and reliability, leveraging distributed computing frameworks and parallel processing techniques.
• Implement and maintain data governance and data security practices to ensure compliance with regulatory standards and protect sensitive information.
• Collaborate with software engineers to integrate data engineering solutions into software applications and systems, enabling real-time data processing and analytics.
• Monitor data infrastructure and proactively identify and resolve performance bottlenecks, data quality issues, and system failures.
• Stay up to date with emerging trends and technologies in data engineering and big data processing, evaluating their applicability to enhance our data infrastructure and processes.
• Collaborate with cross-functional teams to document and communicate data engineering best practices, standards, and guidelines.

• Proven experience working as a Data Engineer or in a similar role, preferably in a fast-paced and data-intensive environment.
• Strong programming skills in languages such as Python, Java, or Scala, with experience in data manipulation, scripting, and automation.
• Proficiency in building and optimizing large-scale data processing systems using distributed computing frameworks such as Apache Spark, Hadoop, or similar technologies.
• Solid understanding of relational and NoSQL databases, data modeling principles, and query optimization techniques.
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services for data storage, processing, and orchestration.
• Knowledge of Databricks is a plus.
• Knowledge of data governance, data security, and privacy practices, including data anonymization, access controls, and compliance regulations (e.g., GDPR, CCPA).
• Strong problem-solving and troubleshooting skills, with the ability to identify and resolve complex data engineering challenges.
• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and convey technical concepts to both technical and non-technical stakeholders.

Makai Digital LLC is a software consulting company with a focus in high performing and high quality software solutions. Headquartered in Miami, Florida, Makai Digital LLC strives to provide clients and consultants with superior staffing solutions.