KubeCon + CloudNativeCon + Open Source Summit + AI_dev China 2024

Explore performance optimization in Kubernetes using Pyroscope. This Lightning Talk will cover advanced strategies to uncover and resolve performance bottlenecks, enhancing application efficiency and reliability. Tailored for developers and SRE engineers, the session will highlight case studies and demonstrate practical applications of these technologies in real-world scenarios. Attendees will leave with actionable insights for effective performance tuning of containerized applications in Kubernetes.

在KubeCon中探索使用Pyroscope进行Kubernetes性能优化。这场闪电演讲将涵盖发现和解决性能瓶颈的高级策略，提升应用程序的效率和可靠性。针对开发人员和SRE工程师定制，本场演讲将重点介绍案例研究，并演示这些技术在实际场景中的实际应用。与会者将获得有关在Kubernetes中对容器化应用程序进行有效性能调优的可操作见解。

This lightening talk will discuss Cloud Native Artificial Intelligence (CNAI) used in education from three aspects. Firstly, introduce the current situations on CNAI applied on children education. Secondly, demo a kids-friendly prototype of AI training process on cloud native infrastructure. Thirdly, talk about more possibilities of CNAI used in pre-school and in-school education(children enlightenment, students assignment corrections, AI teaching... ), also brings up the foreseen malicious abuse of CNAI problems.

这个闪电演讲将从三个方面讨论在教育领域中使用的云原生人工智能（CNAI）。首先，介绍目前在儿童教育中应用CNAI的现状。其次，演示一个儿童友好的AI培训过程原型在云原生基础设施上的应用。第三，讨论CNAI在学前和学校教育中的更多可能性（儿童启蒙，学生作业批改，AI教学...），同时提出CNAI可能存在的恶意滥用问题。

Web Assembly (WASM) has seen significant success in web applications and is now making inroads into other areas like cloud services and even embedded systems that run Real-time Operating Systems (RTOS), such as Zephyr, RT-Thread, Nuttx, and ESP-IDF. This lighting talk will present different approaches to using WASM on embedded systems. - wasmtime (Arm Linux) - wasm-micro-runtime (RTOS) - wasm3 (Baremetal) The above WASM runtimes offer full support for the WASM core specifications. Additionally, their limited support for the WebAssembly System Interface (WASI) enables access to components such as threads, file systems, and network sockets. Although the WASI specifications that provide access to hardware peripherals such as wasi-i2c, wasi-spi, and wasi-digital-io are still in the early stages of development, the potential advantages in portability, security, and deployment simplicity make WASM a promising choice for embedded systems.

Web Assembly（WASM）在Web应用程序中取得了显著的成功，现在正在进入其他领域，如云服务甚至运行实时操作系统（RTOS）的嵌入式系统，例如Zephyr、RT-Thread、Nuttx和ESP-IDF。 这个Lightning Talk将介绍在嵌入式系统中使用WASM的不同方法。 - wasmtime（Arm Linux） - wasm-micro-runtime（RTOS） - wasm3（裸机） 上述WASM运行时完全支持WASM核心规范。此外，它们对WebAssembly系统接口（WASI）的有限支持使得可以访问诸如线程、文件系统和网络套接字等组件。 尽管提供访问硬件外设的WASI规范，如wasi-i2c、wasi-spi和wasi-digital-io仍处于早期开发阶段，但WASM在可移植性、安全性和部署简易性方面的潜在优势使其成为嵌入式系统的一个有前途的选择。

In day-to-day work, both SREs and developers often struggle when working with the observability tools like Prometheus, mainly due to the complex PromQL syntax and disorganized metrics. This talk will showcase how to build Agent. It will have the ability to think, act, and analyze like a human, and it will solve user issues through conversation. This talk presents two main standout ideas: 1. Leveraging RAG technology, it performs multi-path retrieval from local metric knowledge, Prometheus API, Request Logs, and public domain knowledge to produce a consolidated answer. 2. Using the ReAct method, it engages in multi-round dialogues to refine and generate the correct PromQL, call api, and render the dashboard return. This talk, we hope the audience will learn: 1. How to integrate LLM effectively within the observability space. 2. The steps to create an easy-to-use and practical Prometheus AI Agent. 3. Gain experience and insights from practical examples of the Prometheus AI Agent.

在日常工作中，SRE和开发人员在使用像Prometheus这样的可观察性工具时经常遇到困难，主要是由于复杂的PromQL语法和混乱的指标。本次演讲将展示如何构建Agent。它将具有像人类一样思考、行动和分析的能力，并通过对话解决用户问题。 本次演讲提出了两个主要的突出想法： 1. 利用RAG技术，从本地度量知识、Prometheus API、请求日志和公共领域知识中进行多路径检索，以生成一个整合的答案。 2. 使用ReAct方法，进行多轮对话以完善和生成正确的PromQL，调用api，并呈现仪表板返回。 通过本次演讲，我们希望观众能学到： 1. 如何在可观察性领域有效地整合LLM。 2. 创建一个易于使用和实用的Prometheus人工智能Agent的步骤。 3. 从Prometheus人工智能Agent的实际示例中获得经验和见解。

Unveiling the Powerhouse of Knowledge: K8SUG - the Most Active Kubernetes User Group! Step into the world of K8SUG, where passion meets innovation, and connections spark like wildfire. As the brainchild of its founder, the K8SUG Singapore meetup blossomed into a global phenomenon, stretching its reach from Australia to Canada and the UK, with the USA next on the horizon. In just 1.5 electrifying years, our community has swelled to over 14,000 members worldwide, all fueled by the dedication of our volunteers. Join us and be part of the dynamic exchange shaping the future of Kubernetes!

揭开知识强大的力量：K8SUG - 最活跃的Kubernetes用户组！ 走进K8SUG的世界，激情与创新相遇，连接如野火般迸发。作为其创始人的心血结晶，K8SUG新加坡聚会已经发展成为一个全球现象，其影响力从澳大利亚延伸至加拿大和英国，美国也在未来的计划之中。 在短短1.5年的时间里，我们的社区已经发展到全球超过14,000名成员，所有这一切都得益于我们志愿者的奉献。加入我们，成为塑造Kubernetes未来的动态交流的一部分！

The enormous success of the CNCF Landscape has produced an overwhelming number of options in the space, where organizations struggle to establish their platforms quickly. This talk will help guide the community through the thought process of building these platforms, explore some examples of what a healthy source-driven platform ecosystem looks like, and showcase the power that a good cloud native platform will deliver to an organization. Though there are variations of platforms (i.e data, application, machine learning, etc) many start to have the same problems. These include artifact management, secrets management, TLS certificates, cloud permissions, and the list goes on. Providing turnkey solutions for platforms that can be ready in minutes adds much velocity to engineering teams across organizations that adopt the platform engineering model.

CNCF景观的巨大成功在该领域产生了大量的选择，组织往往难以快速建立自己的平台。本次演讲将帮助指导社区通过构建这些平台的思考过程，探讨健康的源驱动平台生态系统的一些示例，并展示一个优秀的云原生平台将为组织带来的力量。 尽管平台有各种变化（如数据、应用程序、机器学习等），许多开始出现相同的问题。这些问题包括工件管理、密钥管理、TLS证书、云权限等等。为平台提供即插即用的解决方案，可以在几分钟内准备就绪，为采用平台工程模型的组织的工程团队带来更大的速度。

Are you a person who wants to fly high? Conquer mountains of Kubernetes certifications then this talk is for you, Giorgi will share all details of kubestronaut program, what benefits does it gives to person and his certification journey as he holds all 5 and even more certificates from CNCF also he has been beta tester and exam developer some of them...

您是想要飞得更高的人吗？征服 Kubernetes 认证的高山？那么这个讲座适合您。Giorgi 将分享 kubestronaut 计划的所有细节，以及它对个人和他的认证之旅带来的好处。他拥有 CNCF 颁发的所有 5 个甚至更多证书，并且还曾担任其中一些证书的测试人员和考试开发人员...

In recent years WASM has been one of the hottest topics in the world of computing due to its portability, small size, fast loading, and compatibility. And given these advantages, WebAssembly is an ideal technology based on sandbox schemes for modern applications including ML/AI. But beyond the browser, currently WebAssembly only can leverage CPU to accelerate ML/AI mostly. Here we offer a flexible way to make running ML/AI on WebAssembly over a variety of AI Accelerators by empowering WASM with a transparent backend interposer. With this, your native ML/AI WebAssembly workloads can seamlessly enjoy the underlying AI accelerators such as CPU, GPU, FPGA and so on, with best performance. During this presentation we also would like to show our latest implementation with demos to help users get direct insight of running ML/AI with WebAssembly on AI accelerators.

近年来，由于其可移植性、体积小、加载速度快和兼容性等优势，WASM已成为计算领域最热门的话题之一。鉴于这些优势，WebAssembly是基于沙箱方案的现代应用程序，包括ML/AI的理想技术。但除了浏览器之外，目前WebAssembly只能利用CPU来加速大部分ML/AI。在这里，我们提供了一种灵活的方式，通过为WASM赋予一个透明的后端插入器，使其能够在各种AI加速器上运行ML/AI。借助这一技术，您的本地ML/AI WebAssembly工作负载可以无缝地享受CPU、GPU、FPGA等底层AI加速器的最佳性能。在本次演示中，我们还将展示我们最新的实现，并通过演示帮助用户直观了解在AI加速器上运行ML/AI的WebAssembly。

In this session, you will learn how Kubernetes allocates resources in worker nodes and how you can obtain the most out of them by choosing the right kind of limits and requests for your workloads. You will cover some practical tips to allocate the right number of nodes and resources to your cluster: - Should you have larger or smaller nodes? - How reservation affects efficiency and cost savings? - How to "defrag" your cluster to optimize allocations And more.

在这场演讲中，您将学习Kubernetes如何在工作节点中分配资源，以及如何通过为工作负载选择正确的限制和请求来充分利用它们。 您将学习一些实用的技巧，来为您的集群分配正确数量的节点和资源： - 您应该选择更大还是更小的节点？ - 预留资源如何影响效率和节约成本？ - 如何“整理”您的集群以优化分配 等等。

The identity authentication mechanism is the most basic function for applications, especially for the enterprise-level management system. They usually need to implement functions such as Identity management, single sign-on, and security policy settings. Keycloak is an open source identity and access management (IAM) solution, it can be easily deployed on Kubernetes, and provide applications with features such as centralized authentication. This speech will explain how our cloud native management system makes full use of the powerful and comprehensive features of Keycloak to implement enterprise-level identity and security access management functions. In order to meet our own requirement, we also created some Keycloak plugins to extend its IDP and Event functions, which can be a good example to learn when customization is needed.

身份认证机制是应用程序最基本的功能，尤其对于企业级管理系统而言。它们通常需要实现身份管理、单点登录和安全策略设置等功能。Keycloak 是一个开源的身份和访问管理（IAM）解决方案，可以轻松部署在 Kubernetes 上，为应用程序提供集中认证等功能。本次演讲将解释我们的云原生管理系统如何充分利用 Keycloak 强大而全面的功能来实现企业级身份和安全访问管理功能。为了满足我们的需求，我们还创建了一些 Keycloak 插件来扩展其身份提供者（IDP）和事件功能，当需要定制化时，这些插件是很好的学习例子。