A data representation format that converts information into sequences of binary digits (0s and 1s) for efficient storage, transmission, and processing, offering compact machine-friendly representations that optimize bandwidth, reduce latency, and enable cross-platform data exchange.
Semantic Classification
Content
Technical Details
- Encoding Approaches:
- Varint Encoding: Variable-length encoding where smaller numbers use fewer bytes
- Tag-Length-Value (TLV): Structured encoding with field identification
- Zigzag Encoding: Efficient encoding for signed integers
- Leading Binary Formats:
- Protocol Buffers (Protobuf): Google’s compact format with schema definition language
- Apache Avro: Row-based format with schema evolution support
- FlatBuffers: Zero-copy access with aligned table-based encoding
- MessagePack: JSON-compatible with 10-40% size reduction
- BSON: Binary JSON for MongoDB and document storage
- Performance Benefits:
- 10-40% smaller payloads compared to JSON
- Faster serialization/deserialization
- Language-agnostic cross-platform support
Applications
- High-throughput message queues
- Microservices communication
- IoT and edge device protocols
- Mobile application data exchange
- AI/ML model parameter storage