Big Data Developer

Role and Responsibilities

• Responsible for design and development of high performing micro-service style server applications, REST APIs, and distributed processing systems using Spark/Scala.
• Analyzes business/ functional requirements and prepares development project schedule, tasks, and estimates
• Identify and build automated solutions for the acquisition, processing, and management of data that would otherwise require manual effort
• Build distributed, scalable, and reliable data pipelines that ingest and process data at scale
• Build the API layer to access Machine Learning Models
• Ensures application design, development schedule, and implementation meet or exceed documented application scope/timeline while adhering to established standards
• Mentor junior development staff in the art of building software systems.
• Bring new ideas in the cloud, big data, and machine learning software development
• Leverage industry knowledge and stay close to technology developments in the open-source and cloud communities
• Collaborate with cross-functional teams
• Practice and enforce Agile and Scrum development methodologies

Qualifications

• Bachelor’s Degree or higher degree in Computer Science/Engineering or related field.
• Must have experience  with Big Data / Analytics technologies like Hadoop, Spark, Python, Scala, R, Machine Learning
• Must have 1-2 years of experience with Azure components like Azure Data Lake Store, SQL Server, HDInsight, Web Jobs, Functions, Key Vault, Data Factory.
• Must have experience exposing Machine Learning Models using REST APIs.
• Must have experience in addressing concerns with big data management (Governance, Role-Based Access Control using LDAP, etc.)
• Must have a solid foundation in data structures, algorithms, design patterns
• Experience with NoSQL databases like MongoDB is a big plus.
• Experience with caching technologies like Redis is a plus
• Knowledge of React, ExpressJS, Node is a plus
• Strong aptitude for problem-solving, particularly to modify and enhance processes and workflows
• Outstanding communicator with both business and technology audiences
• Extensive experience working across teams and operating in an Agile Scrum culture
• Experience with other visualization tools is a plus, such as a Tableau

Technologies we Deal with:


@ Microsoft : .Net, C#, VB.Net, MVC, Entity Framework, LINQ, WebAPI, WPF, WCF, IIS, PowerShell, etc.

@ JAVA : Core Java, Spring, Hibernate, MVC, WebSphere, TomCat, API etc.

@ DevOps : Jenkins, CI/CD pipelines, MS-Build, Maven, Ant, Gradle, Sonar, Artifactory, Ansible, Chef, Puppet, Docker, Pivotal Cloud Foundry, etc.
Tools and Technologies that we serve with the above services:


@ Database and Warehouse Stack: SQL Server, Oracle, ETL, SSIS, Informatica, ElasticSearch, etc.

@ Monitoring Tools: Splunk, Nagios, AppDynamics, etc.

@ Cloud Tech: Googe, AWS, Azure, etc.

@ Others: PHP, Wordpress, Drupal, Python, Django, Flex, NodeJs, Linux, Windows Server, Security, Powershell, Pivotal Cloud Foundary, SAP BW HANA FICO EmplyeeCentral Success Factor, etcd Web: Javascript, jQuery, BootStrap, Material UI, CSS, LESS etc.

@ CRM Tools: SalesForce, CRM Dynamics etc.

@ Reporting : QlikView, Tableau, SQL Server, ElasticSearch Kibana, Graphs, Maps, Charts etc.