Memx Software Engineer at MEMX designs, develops, and maintains data pipelines and integrates data from various sources using Java and BI tools. The role focuses on transforming data into meaningful insights for regulatory products.
Responsibilities
Design, build, and optimize data pipelines and workflows to process, clean, and transform data using Java
Work with various data sources (SQL, NoSQL, cloud data storage) and build integrations to unify data for reporting and analytics
Work closely with tech lead/product management to understand data needs, build dashboards, and develop automated reporting solutions
Design and optimize storage solutions for structured and unstructured data, enhancing data retrieval and performance for BI purposes
Maintain comprehensive documentation of processes, code, and data flows. Follow best practices in code design and deployment to production
Qualification
Experience in handling large datasetsFamiliarity with BI tools like Tableau
Required
Strong proficiency in Java (Java 8+ preferred) with a focus on data-related frameworks and libraries
Experience in handling large datasets, including data cleaning, transformation, and aggregation techniques
Proficiency in working with SQL and NoSQL databases and an understanding of database design principles
Familiarity with BI tools like Tableau, Power BI, or Looker to create and manage reports and visualizations
Experience working with cloud platforms for data storage and processing is a plus
Strong analytical and problem-solving skills to derive insights from data and enhance data processing workflows
Preferred
Familiarity with Python or Java for data processing
Understanding of data modeling and data warehousing concepts
Experience with REST APIs and microservices architecture
Knowledge of version control tools like Git and CI/CD pipelines
