S3
Coverage of S3 in the Nexus archive.
- Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire
Streambed is a tool developed by viggy28 that streams Postgres data to Iceberg on S3 using the Postgres wire protocol. It was showcased on Hacker News with 11 points and no comments as of the article's publication.
- How are you loading Solana SPL transfer data into Snowflake or BigQuery at scale?
The user seeks a scalable solution to load 2+ years of Solana SPL and SOL transfer data into Snowflake or BigQuery for compliance analytics. Current methods like GraphQL pagination are inefficient, and running a Solana archive node is deemed too resource-intensive. The user is inquiring about vendors that provide historical transfer data as partitioned Parquet files via S3.
- Amazon put a filesystem on S3; I showed up with a test suite and bad intentions
AWS launched S3 Files, allowing S3 buckets to be mounted as NFS shares. The author tested the product by spinning up an EC2 instance to attempt breaking it, noting the core S3 product is solid and fairly priced.