In this issue, October 10, 2023 View it in your browser.

Modern AI Stack, Twitter Performance, Building Copilot, Cloudflare Hyperdrive, Serverless First, Cloudflare Turnstile, Enterprise LLMs, Deno, Jakarta EE Data, Predictive Debugger, Svelte 5, Lifelong Careers

Explore the latest trends and best practices in AI at QCon London 2024 (8-10 April).

Connect with world-leading AI and Machine Learning practitioners who are driving change in software. Deep dive in focused tracks including; 'Architecture for the Age of AI' and 'ChatGPT, Bard, Llama, Claude: What's Next in GenAI & Large Language Models (LLMs' to gain real-world action insights and understand the impact on the future of work. Launch pricing expires tomorrow. Book now and save £600.

 

Sponsored by Launch by NTT DATA

Launch by NTT Data

Forge a path to better product outcomes with Value Stream Management as your compass

Unlock maximum value with Value Stream Management (VSM). Visualize, optimize, and supercharge your product delivery. Download our eBook: 'Mastering Outcomes' for a 10-step guide.

https://res.infoq.com/podcasts/overcoming-engineering-challenges/en/smallimage/engineering-culture-podcast-logo-1667540501577-1696494202889.jpeg

Overcoming Some Challenges Engineering Managers Face

In this podcast, Shane Hastie, Lead Editor for Culture & Methods spoke to Ahmed Wasfy about common challenges faced by engineering managers and provides advice on how to overcome them. (Podcast)

https://res.infoq.com/podcasts/adam-jacob-devops-modelling-infrastructure/en/smallimage/InfoQ-Podcast-logo-small-1695916107787.jpg

Adam Jacob Discusses DevOps, Modelling Infrastructure, and Increasing Collaboration

In this episode, Adam Jacob, CEO and co-founder at System Initiative, sat down with InfoQ podcast co-host Daniel Bryant to discuss the evolution and potential future directions of DevOps and managing infrastructure. Topics covered included the challenges remaining within the DevOps movement, how to model and manage infrastructure, and how to increase collaboration between developers and operators. (Podcast)

TOP AI, ML & Data Engineering NEWS HEADLINES

  1. A Modern Compute Stack for Scaling Large AI, ML, & LLM Workloads at QCon SF

  2. Practical Advice for Retrieval Augmented Generation (RAG), by Sam Partee at QCon San Francisco

  3. Chronon - Airbnb’s End-to-End Feature Platform at QCon SF 2023

  4. Build and Deploy Retrieval Augmented Generative Pipelines with Haystack

  5. OpenAI Announces ChatGPT Voice and Image Features

Ray: The Next Generation Compute Runtime for ML Applications

Zhe Zang introduces the basic API and architectural concepts of Ray, as well as diving deeper into some of its innovative ML use cases. (Presentation with transcript included)

Back to Basics: Scalable, Portable ML in Pure SQL

Evan Miller walks through the architecture of Eppo's portable, performant, privacy-preserving, multi-warehouse regression engine, and discusses the challenges with implementation. (Presentation with transcript included)

TOP DevOps NEWS HEADLINES

  1. Disaster Recovery Across a Million Pieces: Michelle Brush at QCon San Francisco

  2. Effective Performance Engineering at Twitter-Scale: Yao Yue at QCon San Francisco

GitHub's Learnings from Building Copilot, an Enterprise LLM Application

GitHub has published an article containing the lessons they learned in building and scaling GitHub Copilot -- an enterprise application using an LLM (Large Language Model). In a post on GitHub's blog, AI product leader Shuyin Zhao describes how -- over three years -- they broke the project down into three stages - "find it", "nail it" and "scale it", and successfully launched GitHub Copilot. (News)

Sponsored by Lightbend

Lightbend

Key Components of an Event-Driven Microservice Platform

This article delves into the ideal features of event-driven microservice platforms, covering scalability, fault tolerance, event sourcing, pub-sub messaging, and integration capabilities. It emphasizes decoupling services, event-driven communication patterns, and choosing the right platform for building robust systems. Learn more.

TOP Cloud NEWS HEADLINES

  1. Cloudflare Hyperdrive: Access PostgreSQL Databases Globally

  2. Lessons from Leading the Serverless First Journey at Capital One: George Mao at QCon San Francisco

  3. Canonical Launches Charmed MLFlow to Simplify Management and Maintenance of ML Workflows

  4. Scale Higher Per-Database Storage Limits and Create More Databases with Cloudflare D1 Open Beta

AWS Lambda under the Hood: Mike Danilov at QCon San Francisco

During the first day of QCon Dan-Francisco 2023, Mike Danilov, a senior principal engineer at AWS, presented on AWS Lambda and what is under the hood. The talk is a part of the “Architectures You’ve Always Wondered About.” Danilov's talk centered around invoke routing, compute infrastructure, and cold starts topics. (News)

TOP Development NEWS HEADLINES

  1. Cloudflare Turnstile: CAPTCHA Replacement Now GA and Available for Free

  2. Combating AI-Generated Fake Images with JavaScript Libraries, by Kate Sills at QCon San Francisco

  3. Defensible Moats: Unlocking Enterprise Value with Large Language Models at QCon San Francisco

  4. Generative AI: Shaping a New Future for Fraud Prevention, by Neha Narkhede at QCon San Francisco

Eating One's Own Dogfood: GitHub Using Actions and Runners for GitHub.com

To improve how they ship software in a scalable and effective way, GitHub has adopted GitHub Actions for a part of their continuous integration system. In particular, they leveraged the new Actions larger runners to get to run 15,000 CI jobs across 150,000 cores. In the process they also extended larger runners capabilities for all their users. (News)

Sponsored by InfluxData

InfluxData

Time series data: Do you need a purpose-built database?

Is time series data just any dataset with a timestamp field? How do time series workloads differ from OLTP or full text search? And what does it mean for your choice of database? Get all the answers in this technical e-book from the creators of InfluxDB. Download now.

TOP Java NEWS HEADLINES

  1. QCon San Francisco 2023 Day 3: Architecting the Cloud, Deep Tech, Frontend Trends, Org Resilience

  2. QCon San Francisco 2023 Day 2: Design for Resilience, Platform Engineering, Modern ML, JVM Trends

  3. QCon San Francisco 2023 Day 1: Architectures, Data Engineering, Infra Languages, Staff+ Skills

  4. Java News Roundup: New JEP Candidates, Spring Cloud, GlassFish, Helidon, Open Liberty, Apache Camel

Simplifying Persistence Integration with Jakarta EE Data

Jakarta Data streamlines Java enterprise data integration. Supporting various databases, it boosts productivity, is open-source, and community-driven. GitHub offers hands-on experience for modernizing enterprise architectures. (Article)

ReSharper 2023.2 IDE Includes Predictive Debugger

At the beginning of August, JetBrains introduced a predictive debugger in the 2023.2 version of ReSharper, its developer productivity extension for Microsoft Visual Studio. The predictive debugger anticipates the future of code execution without actually executing the code and provides visual cues to aid in understanding code behavior. (News)

TOP Web Development NEWS HEADLINES

  1. QCon SF 2023: Streamlining Cloud Development with Deno by Ryan Dahl

Rethinking "Rethinking Reactivity" - Svelte 5 Introduces Runes

In their “Introducing runes” blog post, the Svelte team presents new syntax to express reactive dependencies in web applications. The extra syntax may increase the maintainability of complex web applications, further advancing Svelte’s enterprise readiness. (News)

Sponsored by ScyllaDB

ScyllaDB

NoSQL Database Trends Report: Expectation vs Reality

Download this DZone report to learn which NoSQL database types seemed better in theory than in practice, NoSQL database trends through adoption and use cases, how CAP theorem tradeoffs are shifting year over year, and key considerations for cloud migrations, global deployments, and more. Download Now.

Transitioning to SwiftUI at Airbnb

In 2022, the iOS team at Airbnb decided SwiftUI was sufficiently mature to be adopted for their official app. This required a careful transition, explains Airbnb staff engineer Bryn Bodayle. (News)

TOP Architecture & Design NEWS HEADLINES

  1. Distributed Materialized Views: How Airbnb’s Riverbed Processes 2.4 Billion Daily Events

  2. Managing 238 Million Memberships of Netflix: Surabhi Diwan at QCon San Francisco

  3. Nomura Leverages HashiCorp Consul for Microservices Discovery on AWS EC2

  4. Unpacking How Ads Ranking Works @ Pinterest: Aayush Mudgal at QCon San Francisco

  5. An Engineering Perspective on Cloud Cost Optimization: Erik Peterson at QCon San Francisco

Change Data Capture for Microservices

Gunnar Morling discusses how change data capture (CDC) and stream processing can help developers with typical challenges they often face when working on microservices. (Presentation with transcript included)

Overcomplicated Architecture: Scaling Bottleneck

Cassandra Shum discusses one of the bottlenecks of software development, an overcomplicated architecture, addressing how a company gets to an overcomplicated architecture, and how to get out of it. (Presentation with transcript included)

Sponsored by Cockroach Labs

Cockroach Labs

Building Multi-Tenant SaaS Architectures - Early Release Preview Chapters (By O'Reilly)

Develop a clear view of the landscape of SaaS architecture patterns & strategies, walk through all the moving parts of the SaaS environment, and explore various multi-tenant deployment models. Three chapter excerpt - Download Now.

TOP Culture & Methods NEWS HEADLINES

  1. The Challenges of Producing Quality Code When Using AI-Based Generalistic Models

Why Technical Experience Matters: How To Build a Lifelong Career in Software Development

Sven Reimers shares a few lessons on what to do to advance in a technical career based on technical expertise valued by the industry. (Presentation with transcript included)

InfoQ Call for Contributors

Write for InfoQ: Share knowledge, connect with the global software development community, and grow your career

Are you an experienced senior software engineer or technical leader that is passionate about innovation, adoption of technologies, and the learning and sharing of knowledge with your peers?

InfoQ content is written exclusively by software practitioners like yourself, with the goal of sharing inspiring content from real-world use cases, best practices used by innovator and early adopter companies, and news on emerging trends.

Join the InfoQ Writing Team

SPONSORED CONTENT

Latest Sponsored Resources

documentThe practical guide to internal developer portals