Everything tagged latency, newest first. Tags come from the classifier reading each item's summary; 394 tags used 25 times or more have their own page.
The video demonstrates how UDP simply drops missing packets and keeps going, while TCP preserves ordered delivery by withholding later data until gaps are repaired, creating head-of-line blocking that can hurt real-time applications like voice calls and games where stale data is less useful than missing data.
The content explains that strong leaderboard scores do not guarantee real-world success, because AI applications must balance accuracy, speed, and cost, and should be assessed through both model evaluations and system evaluations before users experience poor latency, errors, or scaling issues.
Scott Robohn, Lenny Giuliano, and Russ White discuss how generative AI might influence internet traffic patterns, focusing on CDNs, latency, edge-based inference, and data sovereignty's impact on infrastructure.
To optimize large language model inference, techniques like KV cache and paged attention from VLLM can significantly reduce latency and costs by efficiently managing GPU memory during the pre-fill and decode phases.
Long context and cache augmented generation (CAG) offer alternative methods to retrieval augmented generation (RAG) for providing large language models (LLMs) with external knowledge by utilizing expanded context windows and caching strategies, though each has its own advantages and challenges related to cost, latency, and performance.
STL has launched India's first hollow core fibre cable, aimed at enhancing data centre networks by reducing latency and accommodating higher bandwidth demands in high-frequency transmission environments.
Anthony Santora, managing director of IT at the USGA, highlights the critical role of Wi-Fi 7 in providing fast, reliable internet during championships, addressing high congestion and demand issues.
The discussion between Scott and Dr. Peter Welcher explores the impact of latency and AI on data center network operations amidst the growing demand for cloud, neocloud, carrier, and enterprise data centers.
AFL, a fibre optic cable manufacturer, will showcase their solutions for reducing GPU-to-GPU latency at Data Centre World 2026 in London, highlighting the importance of bandwidth for AI clusters.
Prompt caching involves storing precomputed key-value pairs of input prompts in large language models to improve processing efficiency, especially for complex prompts, by avoiding repeated computation of these pairs for identical inputs.
Local Uploads on R2 significantly decrease upload request duration by writing data locally and asynchronously copying it to the bucket, ensuring immediate data availability.
Ivo Ivanov, CEO of DE-CIX, emphasizes that America's AI revolution is contingent upon developing the right infrastructure, particularly focusing on reducing latency.
At the DEEP Conference in Zadar, Croatia, I discussed the significance of digital twins in disaster recovery and avoidance testing, focusing on bandwidth and latency emulation.
The guest post evaluates the real-world latency, handover efficiency, and overall performance of the OneWeb satellite network, highlighting its capabilities and challenges in providing global internet connectivity.
Monitoring and troubleshooting network latency involves identifying issues within the network or application layers, requiring collaboration between network engineers and application teams.
Cisco's IT team rapidly developed a cutting-edge AI infrastructure using existing resources and new facilities, overcoming power and latency challenges to support over 25 business use cases.
Interplanetary networking faces challenges like latency, making traditional TCP/IP unsuitable, requiring complex solutions like the Bundle Protocol to manage data transmission between Earth, lunar bases, Mars, and spacecraft.
Audi is revolutionizing its manufacturing systems by virtualizing hardware-based applications onto an edge cloud platform, ensuring microsecond latency and reliability in critical networks, with Cisco's networking solutions providing real-time observability and scalability.
BIGLOBE, a major Japanese ISP, has connected to DE-CIX Frankfurt via GlobePEER Remote to improve latency and network performance for data exchange with European networks.
The guest post examines the potential of using eXpress Data Path (XDP) for fast-path DNS delivery, highlighting both the benefits and challenges associated with its implementation.
Client applications initiate connections to servers using the QUIC transport protocol by leveraging its low-latency capabilities, enhanced security features, and efficient congestion control mechanisms.
Netflix's Tudum platform transitioned from a CQRS architecture with Kafka to using RAW Hollow, enhancing data propagation speed, reducing latency, and improving user experience by leveraging in-memory caching and strong read-after-write consistency.
QUIC, a transport layer protocol, was designed to improve web performance and security, featuring innovations like multiplexing and connection migration, and is increasingly adopted across the public Internet.
TLSv1.3 enhances security and performance, making it an ideal protocol for Zero Trust architectures by offering improved encryption, reduced latency, and simplified processes.
AI networking requires high-bandwidth, low-latency, and reliable interconnects to optimize XPU utilization and minimize job completion time, differing significantly from typical cloud networking.
5G URLLC offers unprecedented 99.999% reliability and sub-1ms latency, crucial for mission-critical applications such as remote surgery, industrial automation, and autonomous vehicles.
Low Earth Orbit satellites offer low-latency global coverage, hybrid network integration, and cost-effective connectivity solutions for enterprises, with implementation strategies for IT teams.
Running AI models on edge devices offers benefits like reduced latency and enhanced privacy, but faces constraints such as limited computational power and energy efficiency challenges.
The Root Server System is a crucial component of the internet's infrastructure, enabling the translation of domain names into IP addresses to facilitate global connectivity.
Drut discusses dynamic system composability, GPU utilization, and the importance of offloading traffic from traditional networking to optimize data center operations.
Traditional SD-WAN optimizes network paths for business-critical apps, but increasing SaaS and cloud adoption challenges its effectiveness, requiring new solutions beyond WAN ops and legacy caching techniques.
Starlink's satellite internet technology has the potential to significantly enhance internet speeds by reducing latency and improving connectivity, especially in remote and underserved areas.
CACM provides an engaging article discussing the issues of bufferbloat and its impact on network latency.
The London Internet Exchange (LINX) is launching LINX Accra, a new Internet Exchange Point in Ghana, to enhance network performance and local traffic management in Africa.
Netflix's Distributed Counter Abstraction is a scalable service built on TimeSeries Abstraction, allowing for efficient distributed counting with low latency, addressing challenges like accuracy, durability, and high availability in diverse use cases.
The presentation highlights the inefficiency of stretched clusters due to SSD read latency compared to cross-site round-trip time, supported by useful online resources.
Ethernet competes with InfiniBand for AI workloads, facing challenges like latency and packet loss, requiring optimization for lossless network performance.
Wi-Fi 7 introduces Multi-Link Operation and airtime optimization, enhancing throughput and reducing latency, as discussed by Keith Parsons and Phil Morgan.
A subtle database race condition in the Partner Program payments system caused incorrect payment emails, resolved by reordering operations.
A groundbreaking study evaluates IPv6 off-net deployment and latency compared to IPv4 among 14 major internet companies.
An open-source tool has been developed to assist ISPs in minimizing customer latency issues.
The challenges of using the IP suite in space involve latency, signal degradation, and the need for specialized protocols.
Wi-Fi 7, soon to arrive, offers enhanced throughput and low latency, with Arista Networks highlighting MLO versions and preamble puncturing.
A new DDoS rule caused increased error responses and latency for Cloudflare customers, highlighting issues and lessons learned.
