You will be a part of the Data Platform engineering and technology team responsible for working with Platform and Solutions Architects to develop using Hadoop and Cloud Technology related to the Big Data platform to support multiple clients & initiatives. You will work with business partners to research, POC, and support the process through the client application installation. The platform architectures created will help to provide new solutions for M2M Learning and enable streamlined onboarding of new teams/applications by using tools, data patterns, and processing methods. You will partner with Solutions Architects to analyze business problems and recommend technical solutions by creating the technology framework to solve the business challenge.
Big Data Management & Analysis
•Writing modules to analyze big data.
•Develop big data applications using Kakfa, Storm, Hive, and Elastic Search
•Understand endpoints of where the data will be pushed by creating a coding template, structure, and attributes.
•Ability to analyze big data elements to determine what areas require coding using JAVA programming language. This code would then be made available to users to implement.
•Support and monitor code implementation by users to ensure there are no bugs, security concerns, or inconsistencies.
•Integrate external data sources and APIs
•This role will be responsible for working with stakeholders to understand business requirements by conducting an assessment and understanding the client’s needs/applications.
•Understand the end to end data flow and help to define an end state architecture by identifying the tools and processes. (end to end technology solutions)
•Develop and write the high level code by creating a use case.
•Partner with the client group to train them on the high level code and use case to explain how it was written and how it can be deployed.
•Work with the application team to develop more robust/complete code.
•Monitor the process and offer supplemental training to ensure the plan is being followed.
Architecture – Platform & Technical
•Responsible for helping to design and recommend platform architecture by looking at different software components (running basic Hadoop and exploring how to bring in additional components).
•Understand how to build onto the Hadoop ecosystem and determining the proper configuration for optimal results. (Determine whether the new systems will be able to run on the same platform or a different one, for example.)
•Research and test a sample data and create a test case.
•Design and develop proof of concept cases/prototypes.
•Provide a formal write up of the results and prepare a recommendation.
•Responsible for providing technical architecture documentation and recommendation based platform architectures, coding mechanisms, and desired solutions.
Code & Software Administration
•Responsible for monitoring the code and overall application to ensure seamless performance.
•Address performance and system issues to support the client and application.
•Responsible for upgrades & migrations – administer testing, coordinate with data lake teams
•Will troubleshoot in Hadoop (Java/Scala technologies) by checking logs, probes, and alerts.
•Will open tickets with vendor to drive the resolution of issues.
•Bachelor’s Degree in Computer Science or other related area or equivalent experience
•Experience with Hadoop, Hive, Pig
•Kafka & Storm – experience creating real time data store and analytics use cases
•Elastic & Kibana – experience with visualization tools
•Programming languages: Core Java, Scala, Python
Ideally, you will also have:
•Hortonworks Hadoop Distribution
•Experience with high level administration in Hadoop using Java and Scala technologies.
•Support of multiple data lakes and platforms.
•Experience working in an agile environment designing and modeling data flows using modeling tools
Equal Employment Opportunity
We're proud to be an equal opportunity employer - and celebrate our employees' differences, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or Veteran status. Different makes us better.
Click here for more info: http://www.verizon.com/about/work/jobs/6589732-big-data-platform-engineer
• Post ID: 50244903 northdfw