Job Description
Project Description:
We need a Senior Python and Pyspark Developer to work for a leading investment bank client.
Responsibilities:
– Develop software applications based on business requirements- Maintain software applications and make enhancements according to project specifications- Participate in requirement analysis, design, development, testing, and implementation activities- Propose new techniques and technologies for software development.- Perform unit testing and user acceptance testing to evaluate application functionality- Ensure to complete the assigned development tasks within the deadlines- Work in compliance with coding standards and best practices- Provide assistance to Junior Developers when needed.- Perform code reviews and recommend improvements.- Review business requirements and recommend changes to develop reliable applications.- Develop coding documentation and other technical specifications for assigned projects.- Act as primary contact for development queries and concerns.- Analyze and resolve development issues accurately.
Mandatory Skills Description:
– 8+ years of experience in data intensive Pyspark development.- Experience as a core Python developer.- Experience developing Classes, OOPS, exception handling, parallel processing .- Strong knowledge of DB connectivity, data loading , transformation, calculation.- Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations.- Lambda Functions, Decorators.- Vector operations on Pandas dataframes /series.- Application of applymap, apply, map functions.- Concurrency and error handling data pipeline batch of size (1-10 gb).- Ability to understand business requirements and translate them into technical requirements.- Ability to design architecture of data pipeline for concurrent data processing.- Familiar with creating/designing RESTful services and APIs.- Familiar with application unit tests.- Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.- Debugging application.
Nice-to-Have Skills Description:
– Knowledge of web backend technology – Django, Python, PostgreSQL.- Apache Airflow- Atlassian Jira- Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus- Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus