Big Data Developer

  • Welkin Technologies LLC
  • New York, NY, 10007
  • Contract
  • Bachelor's Degree
  • Entry Level

Posted on

Job Description:

Role and Responsibilities

  • Responsible for design and development of high performing micro-service style server applications, REST APIs, and distributed processing systems using Spark/Scala.
  • Analyzes business/ functional requirements and prepares development project schedule, tasks, and estimates
  • Identify and build automated solutions for the acquisition, processing, and management of data that would otherwise require manual effort
  • Build distributed, scalable, and reliable data pipelines that ingest and process data at scale
  • Build the API layer to access Machine Learning Models
  • Ensures application design, development schedule, and implementation meet or exceed documented application scope/timeline while adhering to established standards
  • Mentor junior development staff in the art of building software systems.
  • Bring new ideas in the cloud, big data, and machine learning software development
  • Leverage industry knowledge and stay close to technology developments in the open-source and cloud communities
  • Collaborate with cross-functional teams
  • Practice and enforce Agile and Scrum development methodologies

 

Qualifications

  • Bachelor’s Degree or higher degree in Computer Science/Engineering or related field.
  • Must have experience  with Big Data / Analytics technologies like Hadoop, Spark, Python, Scala, R, Machine Learning
  • Must have 1-2 years of experience with Azure components like Azure Data Lake Store, SQL Server, HDInsight, Web Jobs, Functions, Key Vault, Data Factory.
  • Must have experience exposing Machine Learning Models using REST APIs.
  • Must have experience in addressing concerns with big data management (Governance, Role-Based Access Control using LDAP, etc.)
  • Must have a solid foundation in data structures, algorithms, design patterns
  • Experience with NoSQL databases like MongoDB is a big plus.
  • Experience with caching technologies like Redis is a plus
  • Knowledge of React, ExpressJS, Node is a plus
  • Strong aptitude for problem-solving, particularly to modify and enhance processes and workflows
  • Outstanding communicator with both business and technology audiences
  • Extensive experience working across teams and operating in an Agile Scrum culture
  • Experience with other visualization tools is a plus, such as a Tableau

Company Description:

Technologies we Deal with:


@ Microsoft : .Net, C#, VB.Net, MVC, Entity Framework, LINQ, WebAPI, WPF, WCF, IIS, PowerShell, etc.

@ JAVA : Core Java, Spring, Hibernate, MVC, WebSphere, TomCat, API etc.

@ DevOps : Jenkins, CI/CD pipelines, MS-Build, Maven, Ant, Gradle, Sonar, Artifactory, Ansible, Chef, Puppet, Docker, Pivotal Cloud Foundry, etc.
Tools and Technologies that we serve with the above services:


@ Database and Warehouse Stack: SQL Server, Oracle, ETL, SSIS, Informatica, ElasticSearch, etc.

@ Monitoring Tools: Splunk, Nagios, AppDynamics, etc.

@ Cloud Tech: Googe, AWS, Azure, etc.

@ Others: PHP, Wordpress, Drupal, Python, Django, Flex, NodeJs, Linux, Windows Server, Security, Powershell, Pivotal Cloud Foundary, SAP BW HANA FICO EmplyeeCentral Success Factor, etcd Web: Javascript, jQuery, BootStrap, Material UI, CSS, LESS etc.

@ CRM Tools: SalesForce, CRM Dynamics etc.

@ Reporting : QlikView, Tableau, SQL Server, ElasticSearch Kibana, Graphs, Maps, Charts etc.