Job details
Job type contract
Full job description
As the azure synapse engineer, you will be part of a critical team involved in developing and operationalizing azure synapseExperience with spark is a must.
Responsibilities & qualifications:
Understanding of azure synapse analytics architecture and component integrations.
Proactively monitor synapse workload (dedicated sql pool and spark pool) and engage internal/external teams as appropriate to resolve errors/failures/throughput bottleneck.
Execute change tasks including but not limited to security provisioning, schema creation, db role creation, ddl execution, data restoration etc.
Assist application developers and testers with re-engineering / deploying code from infrastructure support standpoint.
Review workload and provide recommendations for performance optimization and operational efficiency.
Identify, troubleshoot and resolve issues/backlogs related to slow/failed/abended jobs in both spark and dedicated sql pools.
Proactively adjust capacity based on current utilization and upcoming usage guestimate projections.
Document and advise developers and end-users about best practices and housekeeping.
Support ingestion pipelines from infrastructure engineering / operational support standpoint.
Work on incidents/onboarding issues related to pivoting to cloud from on-prem datastores.
Be able to identify & resolve performance bottlenecks in spark and sql pools.
Ensure overall system stability, reliability, and manageability of azure synapse analytics deployments.
Experience with governing azure storage accounts and acls is nice to have.
About harvard partners, llp, trusted advisors to it:
Harvard partners is a management consulting firm focused on helping companies more effectively leverage their it investmentWe engage with the c-suite and technology team to help them better understand their it infrastructure and process in order to align the technology strategy and organization to reach the firm’s strategic business goals.some of our practices include:• program/project management and `pmo as a service`• it assessments• business continuity/disaster recovery• optimized infrastructure• concierge managed services• data center strategy, transformation, and migration• cloud management programs• security assessments and remediation• staffing, technical & tacticalworking with the client’s staff, vendors, and consultants, we deliver supportive and collaborative engagements where direct dialog, simplified reporting, productive meetings, and clear responsibility and accountability encourage active participation resulting in consensus-based business outcomes.
