Loading…
strong>Salt Palace | Level 2 | 254 B [clear filter]
Tuesday, November 12
 

10:40am MST

Dog Food Delight: How Argo Workflows Eats Its Own CI - Denise Schannon, Loft Labs & Tim Collins, Pipekit
Tuesday November 12, 2024 10:40am - 11:05am MST
Upstream, Argo Workflow’s CI uses Github Actions. In a true "eating our own dog food" moment, we embarked on a journey to migrate Argo Workflows CI to Argo Workflows itself on our local fork.

Our goals were:
- Boost Efficiency & Reliability: Streamline CI processes for faster development cycles.
- Fork Power: Enable quicker patch releases on our Argo Workflows fork.
- Real-World Inspiration: Provide a practical CI example for Argo Workflows users.

Dive deeper with us:
- Uncover the journey involved in migrating from GitHub Actions to Argo Workflows.
- Explore the challenges and solutions of running Kubernetes inside Kubernetes.
- Learn how we tackled various technical hurdles encountered during the migration.
- Discover the performance, cost, and reliability gains achieved through this self-hosted CI solution.
Speakers
avatar for Tim Collins

Tim Collins

Staff Infrastructure Engineer, Pipekit
Tim is a Staff Infrastructure Engineer at Pipekit, a control plane for Argo Workflows that enables massive data pipelines in minutes, saving engineering time and cloud spend. He has a keen interest in open source technologies and is an active member of the Argo community, often found... Read More →
avatar for Denise Schannon

Denise Schannon

VP of Engineering, Loft Labs
Denise Schannon, VP of Engineering at Loft Labs, is a seasoned engineering and product management leader, specializing in developing open-source software for start-up environments. She excels in scaling engineering teams, delivering superior products, and making Kubernetes more accessible... Read More →
Tuesday November 12, 2024 10:40am - 11:05am MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery

11:15am MST

Breaking the 1.5MB Barrier: Running Large Metaflow Flows with Argo for AI/ML Workloads - Saurabh Garg, Outerbounds
Tuesday November 12, 2024 11:15am - 11:40am MST
Managing large-scale batch workflows efficiently is critical for AI/ML workloads. Data preparation for training or fine tuning models can involve a large number of steps. These make for excellent Argo workflows. But Argo faces the etcd limitation of the 1.5MB object size. This limitation restricts the ability of Argo to run truly large-scale workflows. This talk will delve into the intricacies of this limitation and its impact on AI/ML workflows. We will illustrate with examples how this has been a non-deterministic and frustrating bottleneck for users. To address this challenge, Argo introduced a feature that circumvents the etcd object size restriction. By offloading the bulk of the workflow status to an RDBMS and only storing the reference in etcd, Argo maintains its scaling capabilities still adhering to Kubernetes' limitations. This talk will provide a comprehensive guide on configuring and utilizing the Argo offloading feature in AWS using Aurora Postgres RDS and EKS.
Speakers
avatar for Saurabh Garg

Saurabh Garg

Senior Software Engineer, Outerbounds, Inc.
Tuesday November 12, 2024 11:15am - 11:40am MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Data Processing

12:40pm MST

⚡ Lightning Talk: Enabling Hybrid Cloud Infrastructure with Argo Workflows - Ashlyn Chapman, Cisco
Tuesday November 12, 2024 12:40pm - 12:50pm MST
IT departments adopt hybrid cloud strategies to leverage the strengths of multiple public clouds like AWS, GCP, and Azure, while also maintaining private on-prem solutions to meet stringent security and regulatory compliance requirements. The challenge, however, lies in managing these diverse infrastructures consistently and efficiently. Complex hybrid environments leads to increased operational costs, security vulnerabilities, and a tangled web of provider-specific management tools that can overwhelm even the most seasoned IT teams. Support becomes fragmented, and the promise of a seamless, agile infrastructure seems out of reach. This session will explore how Argo Workflows can serve as the linchpin in a cloud-agnostic infrastructure strategy, enabling teams to manage resources across platforms and providers with unparalleled ease.
Speakers
avatar for Ashlyn Chapman

Ashlyn Chapman

Software Engineer, Cisco
Ashlyn Chapman is a software engineer with a strong background in cloud infrastructure and DevOps. She is committed to reducing resource utilization, improving security, and enhancing deployment efficiency. Adept at collaborating across teams to drive impactful solutions, resulting... Read More →
Tuesday November 12, 2024 12:40pm - 12:50pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery

12:55pm MST

⚡ Lightning Talk: On-Premise and SaaS CI/CD Large-Scale Production Automation with Argo Services - Edgar Magana, Splunk
Tuesday November 12, 2024 12:55pm - 1:05pm MST
In this presentation we will share our Continuous Integrations (CI) pipeline extensions via Argo Workflows in a pure cloud-native way seamlessly integrated with our code versioning system. We will also describe a large-scale asynchronous event-based bus communication that has accelerated our CI pipelines but also increased their resiliency. Finally, we will cover some Continuous Delivery enhancements via ArgoCD and Argo Rollouts. Actually, even our own infrastructure is operated via GitOps model. This collection of open-source projects and internal tools provides a full cloud-native orchestration and gitops experience for Dev, QA and Performance teams. Our solution extends the existing GitLab CI/CD capabilities by providing the ability to orchestrate, build and manage service interdependencies and integrations with other systems and enhanced metrics-based service rollouts in a multi-region cloud architecture.
Speakers
avatar for Edgar Magana

Edgar Magana

Sr. Principal Engineer, Splunk
Edgar has specialized in SaaS Architectures, Micro-services, Software-defined Networking (SDN) and CI/CD processes. Edgar has strong experience in fully automated systems with hands-on experience in technologies such as Docker, Terraform, Kubernetes, Argo, OpenStack and Spinnaker... Read More →
Tuesday November 12, 2024 12:55pm - 1:05pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Progressive Delivery

1:10pm MST

Data Science Workflows Made Easy: Python-Powered Argo for Your Organization - Elliot Gunton, Pipekit Inc. & Flaviu Vadan, Xaira Therapeutics
Tuesday November 12, 2024 1:10pm - 1:35pm MST
Get ready to supercharge your data science workflow development using the power of Hera, the versatile Python SDK for Argo Workflows.
  • Python for Everything: Learn how Hera lets you focus on your business logic and seamlessly integrate it into Argo Workflows – all within your favorite Python environment.
  • Effortless Argo with Hera: Use Hera to craft Argo Workflows with ease using simple Python code that handles common tasks such as template parameters, passing data, and fan-out.
  • Beyond the Basics: We'll explore how Hera provides a base for your organization to build on, using its advanced capabilities, including pre-build hooks, that empower you to configure Hera for your organization's specific needs.
  • Boost your CICD: Learn best practices to build Python workflows efficiently with Hera. Automate developer setups and recurring CICD tasks. 
By the end of this talk, you'll be equipped to supercharge your Argo Workflows with Hera to unlock a new level of automation and efficiency!
Speakers
avatar for Elliot Gunton

Elliot Gunton

Senior Software Engineer, Pipekit Inc
Elliot is a passionate maintainer of Hera, the Python SDK for Argo Workflows. At Pipekit, he is helping to bring scalable data pipelines to the Python world, unlocking the full potential of Argo Workflows for data scientists. Previously, at Bloomberg, Elliot supported Machine Learning... Read More →
avatar for Flaviu Vadan

Flaviu Vadan

Senior Software Engineer, Xaira Therapeutics
TBD
Tuesday November 12, 2024 1:10pm - 1:35pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Data Processing

1:40pm MST

GitOps Safety: Rendering Accurate ArgoCD Diffs Directly on Pull Requests - Dag Bjerre Andersen, Doubble & Regina Voloshin, Codefresh by Octopus Deploy
Tuesday November 12, 2024 1:40pm - 2:05pm MST
As organizations increasingly adopt GitOps and infrastructure-as-code, accurately visualizing manifest changes before they merge has become crucial. Mentally parsing Helm templates and Kustomize patches is too unreliable for catching configuration errors. Join us as we review the current landscape of tools and methods used for visualizing code changes in Argo CD, highlight their limitations, and introduce a new method that leverages ephemeral clusters and Argo CD to render accurate diffs of Helm Charts and Kustomize overlays directly on pull requests. The presentation showcases a tool illustrating this new approach and discusses its overall design. We will demonstrate how the approach can be seamlessly integrated into CI/CD pipelines to prevent deployment errors and streamline code reviews, all without access to live infrastructure. Finally, we'll conclude with an honest assessment of the method's capabilities and limitations and discuss potential areas for future development.
Speakers
avatar for Regina Voloshin

Regina Voloshin

OSS Tech Lead, Codefresh by Octopus Deploy
Regina is a GitOps fan. She is also an ArgoCD contributor and a CNCF Ambassador.
avatar for Dag Bjerre Andersen

Dag Bjerre Andersen

Infrastructure Engineer, Doubble
Dag is an Infrastructure Engineer at Doubble. He is passionate about nearly everything related to Kubernetes and has worked extensively with Argo CD, Flux, and Kubernetes over the past few years
Tuesday November 12, 2024 1:40pm - 2:05pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery

2:10pm MST

Argonauts of Data: Building Scalable and Effective Data Pipelines - Satabrata Paul & Nishchith Shetty, Atlan
Tuesday November 12, 2024 2:10pm - 2:35pm MST
Atlan is a collaborative workspace for data teams that offers functionality like metadata cataloging and data lineage amongst others. Atlan provides connector integrations which ingest metadata from various data sources. As the data estate volume hit a massive scale, the platform encountered performance drags with ETL pipelines impacting resiliency, processing runtimes and efficiency. The existing architecture suffered pipeline failures encompassing computation and storage exhaustion, and parallel and concurrent processing pit-falls with troubling spikes in workflow failure rates. In this talk, Satabrata and Nishchith will share how they leveraged Argo’s parallelization techniques with robust re-try mechanisms and effective artifactory loading to ingest 100 Million assets achieving a 450% reduction in processing time. This improvisation also helped them process 3 Million SQL Queries in just 2 hours reducing overall pipeline runtime by 50% and having Argo-powered horizontal scale-out.
Speakers
avatar for Satabrata Paul

Satabrata Paul

Software Engineer II, Atlan
Satabrata Paul is a seasoned Data Engineer specializing in Backend Systems and CI/CD methodologies to optimize connector integrations for robust data cataloging. At Atlan, he is a part of the Metadata Marketplace team crafting solutions for data asset discovery and lineage. Satabrata... Read More →
avatar for Nishchith Shetty

Nishchith Shetty

Software Engineer, Platform Team, Atlan
Nishchith Shetty is a Software Engineer, part of the Platform Engineering Team at Atlan. He currently lives in San Jose, California. In the past, he has contributed to several open-source projects like Numaflow, CLTK, ScanCode, and Linux Foundation. Nishchith recently graduated from... Read More →
Tuesday November 12, 2024 2:10pm - 2:35pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Data Processing

2:45pm MST

Secure ArgoCD Multi-Cluster Management Across Clouds Without Static Tokens - Marc Boorshtein, Tremolo Security, Inc.
Tuesday November 12, 2024 2:45pm - 3:10pm MST
ArgoCD has the capability to manage more then one cluster, the question is how to securely connect to those remote clusters? This session will explore how to securely connect your remote clusters, regardless of if they're cloud managed or on-prem, using ArgoCD's own native Kubernetes identity through a token exchange to get an identity for that remote cluster. We'll start with the challenge of connecting to remote clusters securely, detail how token exchange works, then walk through updating the ArgoCD container with custom tools, creating Secrets to represent remote clusters, and ApplicationSets to generate the Application without any static tokens. The session will demo management of cloud hosted clusters, on-prem clusters, and clusters that support Kubernetes' beta of AuthenticationConfiguration in 1.30. By the end of this session you'll see where the configuration points are in ArgoCD to secure your GitOps infrastructure without relying on a single cloud provider's IAM.
Speakers
avatar for Marc Boorshtein

Marc Boorshtein

CTO, Tremolo Security, Inc.
Marc is the CTO of Tremolo Security, building open source identity and DevOps solutions in use by US civilian federal agencies, large financial services institutions, and local governments. Prior to starting Tremolo Security, Marc spent over a decade building identity infrastructure... Read More →
Tuesday November 12, 2024 2:45pm - 3:10pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery

3:20pm MST

Tuning Argo Rollouts for Thousands of Workloads - Carlos Sanchez & Roxana Balasoiu, Adobe
Tuesday November 12, 2024 3:20pm - 3:45pm MST
Argo Rollouts makes Progressive Delivery easy to adopt, but some times things do not work as expected. Are the steps correctly set? are the analysis metrics right for the workloads? At Adobe Experience Manager we deploy over 10k customer services to Kubernetes. Changes can occur multiple times per day both internal and from code. A new feature can work fine for 99% of customers but still affect the other 1%, and detecting this just from tests is costly. Enter Argo Rollouts, which allows deploying new versions to a subset of users before rolling them to the totality of the users, and rolling them back if not matching some key metrics, using techniques like canary deployments. We will show our learnings deploying Argo Rollouts to manage over 10k workloads using canaries, how do we balance speed and safety for our customers, and some of the issues that we have faced when adopting it.
Speakers
avatar for Roxana Balasoiu

Roxana Balasoiu

Software Development Engineer, Adobe
Roxana Balasoiu is a Software Development Engineer at Adobe where she has been working for the last 5 years. She is currently working at Adobe Experience Manager and previously contributed to Adobe Analytics. Roxana focuses on enhancing cloud infrastructure and developing new features... Read More →
avatar for Carlos Sanchez

Carlos Sanchez

Principal Scientist, Adobe
Carlos Sanchez is a Principal Scientist at Adobe Experience Manager, specializing in software automation, from build tools to Continuous Delivery and Progressive Delivery. Involved in Open Source for over 20 years, he is the author of the Jenkins Kubernetes plugin and a member of... Read More →
Tuesday November 12, 2024 3:20pm - 3:45pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Progressive Delivery

3:55pm MST

Bridge the Gap Between Terraform and GitOps - Junze Bao & Alexander Matyushentsev, Akuity
Tuesday November 12, 2024 3:55pm - 4:20pm MST
In modern cloud-native environments, GitOps practitioners face a significant challenge: managing dynamically generated resource values across Infrastructure as Code (IaC) tools like Terraform and Kubernetes manifests. This disconnect often leads to manual interventions, hard-coded values, and cumbersome update processes that compromise the efficiency and security of GitOps workflows. This talk introduces the Terraform Bridge, an innovative solution to seamlessly integrate dynamically generated cloud resource attributes with Kubernetes resources. We present a novel controller that leverages Terraform's output feature to automatically update Kubernetes objects such as ConfigMaps and Deployments. This approach eliminates the need for manual updates and hard-coding of sensitive or randomly generated values, thereby enhancing both security and automation in GitOps pipelines.
Speakers
avatar for Junze Bao

Junze Bao

Site Reliability Engineer, Akuity
Junze is a site reliability engineer at akuity.io.
avatar for Alexander Matyushentsev

Alexander Matyushentsev

Co-founder and Chief Architect, Akuity
Argo Co-Creator, Argo CD Lead, and maintainer. Energetic and passionate software engineer with over a decade of software development experience. I'm an enthusiast of continuous integration, agile environments, and a huge open-source believer. Core contributor and maintainer of http://argoproj.io... Read More →
Tuesday November 12, 2024 3:55pm - 4:20pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery

4:30pm MST

Demystifying Argo Events: An Architectural Deep Dive - JP Zivalich, Pipekit Inc. & Becky Pauley, Venafi Jetstack Consult
Tuesday November 12, 2024 4:30pm - 4:55pm MST
Are you new to Argo Events and trying to get your head around how everything works? Join us for an in-depth exploration of the Argo Events architecture, designed to transform you from a novice to a seasoned Argo Events maestro. In this session, we'll embark on a journey through the workings of Argo Events, unraveling the mysteries of the event bus, event source and sensors. We'll delve into their roles and responsibilities, and understand how they go about wrangling events within your Kubernetes cluster. This is the talk that we wished we had heard when we started on our Argo Events journey. Whether you're a seasoned Kubernetes practitioner or a newcomer to the Argo Events realm, this session will provide you with invaluable insights that will elevate your understanding and mastery of this powerful eventing engine.
Speakers
avatar for Becky Pauley

Becky Pauley

Solutions Engineer, Venafi Jetstack Consult
A self-taught engineer and career changer, I finally made the leap from teaching to tech several years ago. I’ve since worked in various Platform and Cloud Engineering roles, with a focus on Kubernetes best practices and Cost-Optimisation. As well as all things Cloud Native, I’m... Read More →
avatar for J.P. Zivalich

J.P. Zivalich

Cofounder, CTO, Pipekit Inc
Cofounder & CTO of Pipekit.
Tuesday November 12, 2024 4:30pm - 4:55pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Data Processing

5:00pm MST

⚡ Lightning Talk: Ranking Argo CD Settings in a Tier List - Gerald Nunn, Red Hat
Tuesday November 12, 2024 5:00pm - 5:10pm MST
Argo CD has a lot of settings and this has only proliferated in each new release of Argo CD. Some settings and values are universally useful and should always be enabled while others are only needed for very specific niche use cases. In this talk we will review many of these settings and values using the always fun and informative concept of the Tier List. Tiers for the settings/values include “Make this the default”, “Almost always useful”, “Good in places”, “Meh?” and finally “Nobody needs this”. Audience participation will be encouraged in this session with audience members helping to rank settings and values by show of hands.
Speakers
avatar for Gerald Nunn

Gerald Nunn

GitOps Technical Marketing Manager, Red Hat
Gerald Nunn is the GitOps Technical Marketing Manager for Red Hat, in this role he evangilizes GitOps and assists Red Hat customers with their GitOps journey. Gerald lives in Victoria, BC with his wife, son and three slightly annoying cats.
Tuesday November 12, 2024 5:00pm - 5:10pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Software Delivery
  • Content Experience Level Any
  • Event + Breaks ArgoCon

5:15pm MST

⚡ Lightning Talk: Orchestrating Scalable DAGs on Argo Workflows Using Fabric8s - Ekansh Gupta, SigNoz & Shivay Lamba, Couchbase
Tuesday November 12, 2024 5:15pm - 5:25pm MST
Argo Workflows, a K-native DAG-style workflow engine for Kubernetes, is a powerful tool for orchestrating complex workflows. Additionally Java is the most popular language for developers in complex organisations. However, using Argo with the Argo Java SDK can be challenging due to limited examples and unclear documentation. This session aims to provide a comprehensive, step-by-step guide on interacting with Argo Workflows using Fabric8’s Custom Resource Definitions (CRD) in Java. Argo Workflows are implemented as 'Custom Resources' in Kubernetes. By leveraging the Fabric8 library’s Custom Resource Definitions, developers can seamlessly interact with Argo Workflows through the Kubernetes API. Join us to learn how to harness the power of Argo Workflows in Java, simplifying your workflow management on Kubernetes.
Speakers
avatar for Shivay Lamba

Shivay Lamba

Developer Relations Engineer, Couchbase
Shivay Lamba is a software developer specializing in DevOps, Machine Learning and Full Stack Development. He is an Open Source Enthusiast and has been part of various programs like Google Code In and Google Summer of Code as a Mentor and is currently a MLH Fellow. He has also worked... Read More →
avatar for Ekansh Gupta

Ekansh Gupta

SDE, SigNoz
Ekansh is a Software Development Engineer with SigNoz, with active involvement in various open-source and cloud native communities for upwards two years now. He was previously an SDE Intern at SteamLabs. He is also a speaker for a couple of talks at PyCon, KubeCon and MozFests. Ekansh... Read More →
Tuesday November 12, 2024 5:15pm - 5:25pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon, Scalability
  • Content Experience Level Any
  • Event + Breaks ArgoCon

5:25pm MST

ArgoCon | Closing Remarks - Christian Hernandez, Event Co-Chair
Tuesday November 12, 2024 5:25pm - 5:30pm MST
Speakers
avatar for Christian Hernandez

Christian Hernandez

Head of Community, Akuity, Inc
Christian is a well rounded technologist with experience in infrastructure engineering, systems administration, enterprise architecture, tech support, advocacy, and product management. Passionate about OpenSource and containerizing the world one application at a time. He is currently... Read More →
Tuesday November 12, 2024 5:25pm - 5:30pm MST
Salt Palace | Level 2 | 254 B
  ArgoCon
  • Content Experience Level Any
  • Event + Breaks ArgoCon
 

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
  • AppDeveloperCon
  • ArgoCon
  • BackstageCon
  • Breaks
  • Cilium + eBPF Day
  • Cloud Native + Kubernetes AI Day
  • Cloud Native StartupFest
  • Cloud Native University
  • Data on Kubernetes Day
  • EnvoyCon
  • Istio Day
  • Kubernetes on Edge Day
  • Observability Day
  • OpenFeature Summit
  • OpenTofu Day
  • Platform Engineering Day
  • Registration
  • WasmCon