DevOps Engineer
2022 - PRESENT
辉瑞- PGS操作的见解
- 使用GitHub Actions设计和实现CI/CD, Terraform, 和一家全球制药公司的舵手.
- 设计和实现灾难恢复和备份技术.
- 使用Splunk, Grafana和Prometheus进行日志记录和监控.
- 在Kubernetes中管理多个环境,并使用GitHub Actions提供CD.
- 完成PostgreSQL的部署和配置, Elasticsearch, Kafka, Redis, Solr, 和Zookeeper使用Kubernetes中的操作符.
技术:码头工人, Kubernetes, Jenkins, Linux, PostgreSQL, GitHub, Elasticsearch, Amazon RDS, Amazon Aurora, Bash, Amazon S3 (AWS S3), Load Balancers, Amazon Route 53, Amazon EC2, Firewalls, Cost Control, Cost Analysis, DevOps, 亚马逊网络服务(AWS), DNS, Docker Hub, CI/CD Pipelines, Ubuntu, Autoscaling, Cloud Architecture, Monitoring, Git, Cloud Services, Bash Script, 系统管理, Networking, Cron, Grafana, AWS云架构, AWS DevOps, Amazon Firewall, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR), Infrastructure, 持续交付(CD), 持续集成(CI), 持续发展(CD), Unix, Cloud, Cloud Security, Deployment, AWS ELB, AWS CLI, Amazon EBS, Snowflake, AWS Auto Scaling, Amazon EC2 API, Authorization, Authentication, IT Security, Identity & 访问管理(IAM), 亚马逊虚拟私有云(VPC), Microservices, Containers, VPN, Redis, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Splunk, GitOps, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, Microsoft SQL Server, 数据同步, Logging, 解决方案架构, App 保护。, Web Security
DevOps工程师(AWS云基础设施)
2021 - 2021
Alteryx -开发运维工程支持
- 使用最新的DevOps和云部署技术(AWS EKS), RDS, EC2, VPC, GCP)创造创新的新产品集成到我们的平台. 为自助服务分析公司构建和部署作为代码的基础设施(Terraform).
- 为在GitLab和Argo CD中使用CI/CD原则的工程团队提供支持. 设计和测试高安全性, 用于承载多租户和单租户部署的防泄漏后端基础设施.
- 使用RDS执行标准数据库管理职责, PostgreSQL, Snowflake, 和其他ANSI SQL平台. 提供规模成本分析,以纳入新产品进入市场的策略.
Technologies: 亚马逊网络服务(AWS)、Terraform、基础设施即代码(IaC)、DevOps, Linux, Docker, Kubernetes, AWS Systems Manager, AWS IAM, GitLab CI/CD, Ansible, CI/CD Pipelines, Cloud Security, Web应用防火墙(WAF), SecOps, SIEM, Amazon S3 (AWS S3), Amazon RDS, Load Balancers, Amazon Route 53, Amazon EC2, Firewalls, DNS, Docker Hub, API Gateways, Ubuntu, Autoscaling, Cloud Architecture, Monitoring, Git, Cloud Services, Bash Script, 系统管理, Networking, Cron, Grafana, AWS云架构, ETL, AWS DevOps, Amazon Firewall, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR), Infrastructure, Linux服务器管理, Bash, 持续交付(CD), 持续集成(CI), 持续发展(CD), Unix, Cloud, GitHub, Deployment, AWS ELB, AWS CLI, Amazon EBS, AWS Auto Scaling, Amazon EC2 API, Authorization, Authentication, IT Security, Identity & 访问管理(IAM), 亚马逊虚拟私有云(VPC), Microservices, Containers, Bitbucket, Azure Blob存储API, Azure Queue Storage, Azure Tables, VPN, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Splunk, GitOps, Scalability, Orchestration, IaaS, SSH, SFTP, Microsoft SQL Server, 数据同步, Logging, 解决方案架构, App 保护。, Web Security
高级软件工程师|高级DevOps工程师|软件架构师
2020 - 2021
Volvo Cars
- 开发复杂的应用程序来集成多个系统,以便在AWS上的大型集群或大型机器上生成训练结果.
- 将复杂的PostgreSQL脚本迁移到Microsoft SQL Server. 准备和配置SQL数据库.
- 编写Kubernetes微服务,集成多个第三方应用程序,如retol和Leanplum.
- 在Python中实现了一个复杂的调度器,以在特定时间段运行作业. 集成的Vault由HashiCorp作为秘密管理工具和配置服务器.
- 配置和实现整个DevOps基础架构. 一切都只能通过VPN访问.
- 为在Kubernetes上部署每个应用编写了Helm图表,并为每个应用编写了自定义Dockerfile.
技术:Python, Kubernetes, PostgreSQL, SQL, Vault, Leanplum, CI/CD Pipelines, Docker, Amazon EC2, Linux, MySQL, Terraform, Amazon EKS, Helm, Amazon弹性容器服务(Amazon ECS), Architecture, Security, Amazon S3 (AWS S3), Amazon RDS, Load Balancers, Amazon Route 53, Firewalls, Cost Control, Cost Analysis, DevOps, 亚马逊网络服务(AWS), DNS, Docker Hub, API Gateways, Ubuntu, Back-end, Autoscaling, Azure Active Directory, Azure DevOps, Azure云服务, Cost Management, Cloud Architecture, Monitoring, Git, Cloud Services, Bash Script, Virtualization, 系统管理, Networking, Cron, Ansible, Grafana, AWS云架构, ETL, AWS DevOps, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR), Infrastructure, Project Consultancy, Azure Blobs, Microsoft Azure, Azure虚拟机, Azure, Linux服务器管理, Bash, 持续交付(CD), Azure DevOps服务, Python 3, 持续集成(CI), 持续发展(CD), Unix, Cloud, Cloud Security, GitHub, Deployment, AWS ELB, AWS CLI, AWS IAM, Amazon EBS, APIs, Kubernetes运营(kOps), 机器学习操作(MLOps), AWS Auto Scaling, Amazon EC2 API, Authorization, Authentication, IT Security, Microsoft Team Foundation服务器, Microservices, Leadership, Containers, Azure Service Bus, Azure Blob存储API, Azure Queue Storage, Azure Tables, VPN, Web Development, 微软Azure云服务器, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, GitOps, Azure Functions, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Microsoft SQL Server, 数据同步, Logging, 解决方案架构, App 保护。, Web Security
Twinner
- Azure中跨多个区域的托管集群.
- 构建了Azure资源管理器(ARM)模板,以自动执行资源部署.
- 开发和维护Jenkins作业,使部署过程自动化.
- 编写用于azure资源部署的Bash和PowerShell脚本.
- 管理的Kubernetes集群(自动缩放), ingress, 使用Prometheus和Grafana进行配置监控.
- 配置和调整功能应用程序和web应用程序,以提高性能.
- 使用SaltStack开发和维护自动部署.
- HashiCorp使用Vault管理秘密和配置.
- 调试用c#、Java和JavaScript编写的应用程序.
技术:Windows PowerShell, Bash, Vault, Azure云服务, Kubernetes, SaltStack, Terraform, Helm, Architecture, Security, Load Balancers, Linux, Firewalls, Cost Control, Cost Analysis, DevOps, DNS, 内容分发网络(CDN), Docker Hub, API Gateways, CI/CD Pipelines, Ubuntu, Back-end, Autoscaling, Azure Active Directory, Azure DevOps, Cost Management, Cloud Architecture, Docker, MySQL, Monitoring, Git, Cloud Services, Bash Script, Virtualization, 系统管理, Networking, Cron, Ansible, Grafana, Windows Server, Shell Scripting, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR), Infrastructure, Project Consultancy, Azure Blobs, Microsoft Azure, Azure虚拟机, Azure, Linux服务器管理, Python, 持续交付(CD), Azure DevOps服务, 持续集成(CI), 持续发展(CD), Unix, Cloud, ADFS, Cloud Security, GitHub, Deployment, Azure SQL, Azure Kubernetes服务(AKS), Kubernetes运营(kOps), Flask, AWS Auto Scaling, Amazon EC2 API, .NET, CentOS, Azure IaaS, Authorization, Authentication, IT Security, On-premise, Microsoft Team Foundation服务器, Identity & 访问管理(IAM), Kafka Streams, 亚马逊虚拟私有云(VPC), Microservices, Leadership, Containers, Azure Service Bus, Azure Blob存储API, Azure Queue Storage, Azure Tables, .NET Core, VPN, Web Development, 微软Azure云服务器, 虚拟专用服务器, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Amazon Cognito, PHP, Splunk, GitOps, Azure Functions, AWS Amplify, Web Scalability, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Amazon Lightsail, Microsoft SQL Server, 数据同步, Logging, 解决方案架构, App 保护。, Web Security
体育数据服务有限公司.
- 为多个客户端部署并配置OpenVPN.
- 在Google Cloud和Azure中管理多个Spark集群.
- 构建了一个Scala应用程序来同步PostgreSQL数据库.
- 开发了一个Spark Scala应用程序,以分布式模式将视频分成数千个片段.
Technologies: Scala, PostgreSQL, Hadoop, Spark, Azure, Google Cloud, Amazon EKS, Helm, Architecture, Security, Amazon RDS, Load Balancers, Amazon Route 53, Amazon EC2, Linux, Firewalls, Cost Control, Cost Analysis, DevOps, DNS, Docker Hub, API Gateways, CI/CD Pipelines, Ubuntu, Back-end, Cost Management, Cloud Architecture, Docker, MySQL, Monitoring, Git, Cloud Services, Bash Script, Virtualization, 系统管理, Networking, Cron, Ansible, Windows Server, 谷歌云平台(GCP), Shell Scripting, Nagios, HAProxy, 大数据架构, AWS云架构, ETL, Big Data, AWS DevOps, Amazon Firewall, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR),基础设施,项目咨询,节点.js, Azure Blobs, Microsoft Azure, Azure虚拟机, Linux服务器管理, Bash, Java, 亚马逊网络服务(AWS), Python, C#, 持续交付(CD), Azure DevOps服务, Python 3, 持续集成(CI), 持续发展(CD), Unix, Cloud, Azure应用网关, Cloud Security, GitHub, Deployment, AWS ELB, AWS CLI, AWS IAM, Amazon EBS, Azure Kubernetes服务(AKS), Azure SQL, REST APIs, APIs, Flask, NGINX, AWS Auto Scaling, Amazon EC2 API, .NET, CentOS, Azure IaaS, Authorization, Authentication, IT Security, Healthcare, DigitalOcean, On-premise, Microsoft Team Foundation服务器, OutSystems, Kafka Streams, 亚马逊虚拟私有云(VPC), Microservices, Leadership, Containers, .NET Core, VPN, Web Development, 微软Azure云服务器, 虚拟专用服务器, DevOps Engineer, AWS NAT Gateway, 软件架构, Amazon Cognito, PHP, ECS, TypeScript, 谷歌计算引擎(GCE), Google Kubernetes Engine (GKE), Google BigQuery, 谷歌云存储, 谷歌云控制台, Vertex AI, DevSecOps, AWS Amplify, Web Scalability, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Amazon Lightsail, Microsoft SQL Server, 数据同步, Logging, 解决方案架构, App 保护。, Web Security
Versive
- 使用PySpark解决了版本平台中的复杂问题.
- 找到了在客户机集群上使用Kerberos的各种问题的解决方案.
- 设计并实现了一个纱线友好的拉链组件, 其中包括版本代码, 将使用Yarn发送到客户端安全集群.
- 升级平台,支持多个Spark版本.6 and 2.
- 改进编排脚本,基于集群资源动态避免OOM.
技术:Python, Scala, Jenkins, Spark, Amazon, Security, Amazon S3 (AWS S3), AWS CloudFormation, Amazon RDS, Load Balancers, Amazon Route 53, Amazon EC2, Linux, Firewalls, Cost Control, Cost Analysis, DevOps, 亚马逊网络服务(AWS), DNS, 内容分发网络(CDN), Docker Hub, API Gateways, CI/CD Pipelines, Ubuntu, Back-end, Cloud Architecture, MongoDB, MySQL, Monitoring, Git, Cloud Services, Bash Script, Virtualization, 系统管理, Networking, Cron, Nagios, HAProxy, 大数据架构, AWS云架构, ETL, Big Data, AWS DevOps, Amazon Firewall, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR),基础设施,项目咨询,节点.js, Azure Blobs, Microsoft Azure, Azure虚拟机, Azure, Linux服务器管理, Bash, 持续交付(CD), Python 3, 持续集成(CI), 持续发展(CD), Unix, Cloud, Azure应用网关, Cloud Security, GitHub, Deployment, AWS ELB, AWS CLI, AWS IAM, Amazon EBS, REST APIs, APIs, Flask, NGINX, AWS Auto Scaling, Amazon EC2 API, CentOS, Authorization, Authentication, IT Security, On-premise, Identity & 访问管理(IAM), Kafka Streams, 亚马逊虚拟私有云(VPC), Microservices, Leadership, Containers, .NET Core, VPN, Web Development, 虚拟专用服务器, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Amazon Cognito, Amazon Simple Queue Service (SQS), Amazon Simple Email Service (SES), ECS, VPC, DevSecOps, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Microsoft SQL Server, 数据同步, Logging, 解决方案架构
Ubix
- 设计并实现了Ubix的新功能.io核心平台(Ubix DSL和scala).
- 开发并实现Spark流Lambda架构.
- 使用Git和Jenkins创建并实现持续集成的过程.
- 重新设计并实现了一个供应工具, 一个带有Docker和Ansible的Scala应用,可以选择部署到外部云(AWS)上。.
技术:亚马逊网络服务(AWS), Scala, Jenkins, Cassandra, Apache Hive, Apache Kafka, Spark, Docker, Architecture, Security, Amazon S3 (AWS S3), AWS Lambda, AWS CloudFormation, Amazon RDS, Amazon CloudWatch, Load Balancers, Amazon Route 53, Amazon EC2, Linux, Firewalls, Cost Control, Cost Analysis, DevOps, DNS, 内容分发网络(CDN), Docker Hub, API Gateways, CI/CD Pipelines, Ubuntu, Back-end, Cost Management, Cloud Architecture, MongoDB, MySQL, Monitoring, Git, Cloud Services, Bash Script, Virtualization, 系统管理, Networking, Cron, Ansible, RabbitMQ, Windows Server, Nagios, HAProxy, 大数据架构, AWS云架构, ETL, Big Data, AWS DevOps, Amazon Firewall, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR),基础设施,项目咨询,节点.js, Linux服务器管理, Bash, Java, Python, 持续交付(CD), Python 3, 持续集成(CI), 持续发展(CD), Unix, Cloud, Azure应用网关, Cloud Security, GitHub, Deployment, AWS ELB, AWS CLI, AWS IAM, Amazon EBS, REST APIs, APIs, 机器学习操作(MLOps), NGINX, Amazon EC2 API, CentOS, Authorization, Authentication, IT Security, Healthcare, On-premise, Identity & 访问管理(IAM), Kafka流,亚马逊虚拟私有云(VPC),领导力,容器, .NET Core, VPN, Web Development, 虚拟专用服务器, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Amazon Cognito, Angular, Apache Solr, Amazon Simple Queue Service (SQS), Amazon Simple Email Service (SES), ECS, VPC, DevSecOps, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Microsoft SQL Server, 数据同步, Logging, 解决方案架构
Atigeo
- 带领团队将基础架构从Hadoop和Hive发展到Spark、Shark、Tachyon和Mesos.
- 为Berkeley Data Analytics Stack (BDAS)提供企业支持.
- 为多个分析应用开发ETL管道.
- 在公共云和VPC场景(AWS)以及内部部署(JP Morgan Chase Bank)上构建和维护xPatterns的部署脚本。.
Technologies: Scala, Java, YARN, Mesos, Apache Solr, Cassandra, Apache Hive, Spark, Hadoop, Amazon S3 (AWS S3), AWS CloudFormation, Amazon CloudWatch, Load Balancers, Amazon Route 53, Amazon EC2, Linux, Firewalls, Cost Control, Cost Analysis, DevOps, 亚马逊网络服务(AWS), DNS, 内容分发网络(CDN), CI/CD Pipelines, Ubuntu, Cost Management, Cloud Architecture, Monitoring, Git, Cloud Services, Bash Script, 系统管理, Networking, Cron, Subversion (SVN), Ansible, RabbitMQ, Nagios, HAProxy, 大数据架构, AWS云架构, ETL, Big Data, AWS DevOps, Amazon Firewall, JavaScript, Backup & 恢复、数据恢复、自动化、业务连续性 & 灾难恢复(BCDR), Infrastructure, Linux服务器管理, Bash, Python, 持续交付(CD), 持续集成(CI), 持续发展(CD), Unix, Cloud, Azure应用网关, Cloud Security, GitHub, Deployment, AWS ELB, AWS CLI, AWS IAM, Amazon EBS, REST APIs, APIs, 机器学习操作(MLOps), NGINX, Amazon EC2 API, .. NET、CentOS、授权、身份验证、医疗保健、内部部署、身份 & IAM (Access Management)、亚马逊虚拟私有云(VPC)、Leadership、 .NET Core, VPN, Web Development, 虚拟专用服务器, DevOps Engineer, AWS NAT Gateway, Jira, Confluence, 软件架构, Amazon Simple Queue Service (SQS), Amazon Simple Email Service (SES), VPC, DevSecOps, Scalability, 基础设施即代码(IaC), Orchestration, IaaS, SSH, SFTP, Microsoft SQL Server, 数据同步, Logging, 解决方案架构