Shanvi Staffing and Training Services
Location
Gurgaon | India
Job description
Job Summary
Hands-on experience with writing Spark or Map-Reduce jobs and proficient understanding of distributed computing principles. Proficient in more than one of Python, Java, Scala & Shell-Scripting.
Job Responsibilities:
Understand & provide innovative solutions to business and product requirements using Big Data Architecture
Take ownership of end-to-end data-pipeline including system design and integrating required Big Data tools & frameworks
-Implementing ETL processes and constructing data warehouse (HDFS, S3, etc.) at scale
Developing highly performant Spark jobs for deriving data insights and building user preference, user segmentation, and recommendation engines
Developing required querying and reporting tools for various business teams
Requirements:
Working knowledge of Linux systems and distributed systems is a must.
Knowledge of scripting language like python/scala
Hands-on experience with writing Spark or Map-Reduce jobs and proficient understanding of distributed computing principles.
Experience with Lambda Architecture and building required infrastructure.
Proficient in more than one of Python, Java, Scala & Shell-Scripting.
Experience with integration of data from multiple data sources
Experience with various messaging systems, such as Kafka
Preferred:
Understanding of Spark and HDFS internals.
Experience with Big Data querying tools, such as Hive, Pig, and Impala
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Experience with resource managers such as YARN, Mesos
Experience with stream-processing systems such as Storm, Spark-Streaming, etc.
Knowledge of Lucene, Solr, Elastic Search or any other similar technology is a plus.
Prior experience in developing segmentation and recommendation systems is recommended.
Experience with reporting tools Apache Zepplin.
About Roposo
Roposo - TV by the People is a unique platform where people express visually with homemade videos and photos. The app offers a seamless browsing experience with user-generated channels. Users can watch what is relevant to them and at the same time connect with a wide audience from around the globe. With its interesting post creation and editing tools, users can share their life, showcase their unrevealed talents, and voice their opinion on things that matter.
Explore the open platform, and
• Show the world what makes you unique - you are a hero, give your audience a peek into your super-awesome life.
• Get creative with fascinating desi GIF stickers, voice-over and music for your handmade videos and photos - express and share your life, create stories for your every mood.
• Enjoy a TV-like browsing experience with hands-free scrolling and a full-screen view - there's a whole lot of entertainment to be discovered.
• Privileged access to personalised channels with interesting episodes, where you can find relevant stories as per your interest and preferences, and connect with a like-minded audience that resonates your thoughts and opinions.
• With chat-to-buy you can now connect with thousands of home sellers and buy their products through the Roposo Bazaar.
Its user-base of 4 million makes Roposo a promising business platform for skilled home sellers from pan-India. With over 2 million screen views per day and 4,00,000 posts a month, the venture has established itself as a niche player in the Indian digital space. A brand of Relevant E-solutions headquartered in Gurgaon, Roposo is the brainchild of three IIT Delhi alumni, Mayank Bhangadia, Avinash Saxena and Kaushal Shubhank.
Big Data,Data Analysis
Designation: Data Engineer Pin Job Analytics / Business Intelligence / Data Science Job at Roposo
Vacancies: 2
Experience: 2.0 Year(s) - 6.0 Year(s)
Telephonic Interview scheduled. Apply now and attend interview.
Job tags
Salary
