Responsibilities

• Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues are fully tested with minimal defects
• Partner with a software development team to implement best practices and optimize the performance of Data applications to ensure that client needs are met at all times
• Collaborate across the company and interact with our customers to understand, translate, define, and design their business challenges and concerns into innovative solutions
• Research on new Big Data technologies, assessing maturity and alignment of technology to business and technology strategy
• Work in a rapid and agile development process to enable increased speed to market while maintaining  appropriate controls

Requirements

• BE/B.Tech/MCA with At least 6+ years of total IT experience with 4+ years of experience in design and development using Hadoop technology stack and programming languages
• Preferred hands­-on experience in 2 or more areas:
• Hadoop, HDFS, MR
• Spark Streaming, Spark SQL, Spark ML
• Kafka/Flume
• Apache NiFi
• Worked with Hortonworks Data Platform 
• Hive / Pig / Sqoop
• NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB
• Visualization & Reporting frameworks like D3.js, Zeppelin, Grafana, Kibana Tableau, Pentaho
• Scrapy for crawling websites
• Elastic Search
• Google Analytics data streaming
• Data security (Kerberos/Open LDAP/Knox/Ranger)
• Good knowledge of the current technology landscape and ability to visualize industry trends
• Working knowledge of Big Data integration with third-party or in-house built Metadata Management, Data Quality, Master Data Management solutions, structured/unstructured data
• Active community involvement in terms of articles, blogs or speaking engagements at conferences