Computer Vision news and developer summaries

This article explores atmospheric scattering in shaders to render realistic skies and planetary atmospheres. It details the step-by-step implementation of Rayleigh and Mie scattering, ozone absorption, and the use of LUTs for performance optimization. The guide explains integrating these effects as post-processing into WebGL scenes to create accurate lighting, sunsets, and volumetric fog.

GenCAD is an image-conditional generative model that produces both 3D CAD models and their underlying parametric command sequences. By utilizing transformer encoders, contrastive learning, and diffusion models, GenCAD overcomes limitations of mesh or voxel representations, enabling precise, modifiable CAD generation essential for engineering and manufacturing workflows.

This browser-based Gaussian splat generator utilizes Apple's SHARP model to convert single images into 3D Gaussian splats. Built with React and TypeScript, it uses ONNX Runtime Web for local inference, offering in-page previews and .ply file exports. This experimental tool demonstrates sophisticated client-side 3D reconstruction using WebGPU and WASM, requiring significant memory and proper model asset serving.

IMAGE-BLASTER is an open-source tool that converts single images into 3D environments, meshes, and SFX in minutes. It leverages Claude, World Labs, FAL, and ElevenLabs to generate 3D models, Gaussian splats, and audio. It is designed to integrate seamlessly into game engines, DCC software, and web applications for rapid asset creation.

3D Gaussian splatting (3DGS) reconstructs 3D scenes from 2D images by modeling them as a collection of Gaussian distributions. This guide demonstrates building a simplified, real-time renderer using C++ and OpenGL. Key concepts include spherical harmonics for view-dependent color, spatial projection of covariance matrices, and sorting translucent splats for correct alpha blending.