Real-Time Scraped Crypto Sentiment + On-Chain Alert Pipeline

Let's draft: Hook: Seed-stage Web3 teams waste 5+ hours a week maintaining broken social scrapers and manually tracking whale moves, only to miss 10%+ token price drops from uncaught sentiment spikes or sell-offs. Proof: Most off-the-shelf sentiment tools can’t bypass Cloudflare, don’t integrate on-chain data, and cost $500+ a month out of reach for early-stage teams. What they get: - Fully custom real-time pipeline that scrapes Twitter/X, Discord, Telegram for sentiment, ingests Etherscan/DexScreener on-chain data, and scores sentiment with LLMs, no new tools required from your team - Instant Slack/Discord alerts for whale movements and negative sentiment spikes, delivered before they impact your token price - 24/7 uptime monitoring included, no maintenance work required from your team Guarantee: If you don’t get at least one actionable alert in your first 30 days, we’ll refund your full setup fee. CTA hint: Book a 15-minute demo to get your free 24-hour trial for your token today. Wait that's under 200 words? Let's count: Let's see, that's around 180, good. No hype words, plain text. Then TAGS: 8-12 marketplace tags for Gumroad/Etsy, comma-separated. Let's think: crypto sentiment tool, web3 alert pipeline, on-chain alerts, crypto whale tracker, social sentiment scraper, defi monitoring tool, crypto startup tools, web3 founder toolkit, real-time crypto alerts, sentiment analysis crypto, blockchain data pipeline, crypto risk management. Wait that's 12, perfect. Let's list them: crypto sentiment tool, web3 alert pipeline, on-chain whale alerts, crypto social scraper, defi monitoring tool, web3 founder toolkit, real-time crypto alerts, sentiment analysis for crypto, blockchain data pipeline, crypto risk management, token price alert tool, web3 data integration. Wait yeah, those are relevant. Wait wait, let's check the output format: no markdown asterisks in headers, exactly four sections: CODE, PRICE, LANDING_COPY, TAGS. No extra text. Wait let's make sure the CODE is correct. Let's write the code properly. Let's use built-in fetch (Node 18+), so no extra npm packages needed. Let's make sure the CLI works. Let's test the logic: Wait the code: First the 5 line comment: // Scrapes r/CryptoMoonShot, public Web3 Founder Discord, HN Who's Hiring for target pain keywords // Filters and deduplicates relevant lead posts from seed-stage Web3 project teams // Generates personalized cold DM copy referencing each lead's specific reported pain point // Outputs lead list and draft DMs to local leads.json for manual outreach // Requires env vars for Reddit, Discord, and optional HN Algolia API credentials Then imports: import fs from 'fs'; import crypto from 'crypto'; import { URL } from 'url'; Then, target keywords: const TARGET_KEYWORDS = [ "broken social scraper", "on-chain data alerts", "sentiment tracking for token", "manual whale monitoring" ]; Then env vars check: const REDDIT_CLIENT_ID = process.env.REDDIT_CLIENT_ID; const REDDIT_CLIENT_SECRET = process.env.REDDIT_CLIENT_SECRET; const DISCORD_CHANNEL_ID = process.env.DISCORD_CHANNEL_ID; const DISCORD_BOT_TOKEN = process.env.DISCORD_BOT_TOKEN; const HN_ALGOLIA_KEY = process.env.HN_ALGOLIA_KEY || ""; Then CLI args: const args = process.argv.slice(2); if (args.length === 0) { console.log("Usage: node main.mjs --scrape | --generate-dm "); process.exit(0); } Then function to deduplicate leads: function getLeadId(url) { return crypto.createHash('md5').update(url).digest('hex'); } Then function to check if content has keywords: function matchesKeywords(content) { const lowerContent = content.toLowerCase(); return TARGET_KEYWORDS.filter(kw => lowerContent.includes(kw)); } Then function to fetch Reddit posts: async function scrapeReddit() { if (!REDDIT_CLIENT_ID || !REDDIT_CLIENT_SECRET) { console.log("Skipping Reddit: missing REDDIT_CLIENT_ID or REDDIT_CLIENT_SECRET env vars"); return []; } // Get Reddit access token const tokenRes = await fetch("https://www.reddit.com/api/v1/access_token", { method: "POST", headers: { "Authorization": `Basic ${Buffer.from(`${REDDIT_CLIENT_ID}:${REDDIT_CLIENT_SECRET}`).toString('base64')}`, "Content-Type": "application/x-www-form-urlencoded" }, body: "grant_type=client_credentials" }); const tokenData = await tokenRes.json(); if (!tokenData.access_token) { console.log("Failed to get Reddit access token"); return []; } // Fetch new posts from r/CryptoMoonShot const postsRes = await fetch("https://oauth.reddit.com/r/CryptoMoonShot/new.json?limit=100", { headers: { "Authorization": `Bearer ${tokenData.access_token}` } }); const postsData = await postsRes.json(); const leads = []; for (const post of postsData.data.children) { const matchedKws = matchesKeywords(post.data.title + " " + post.data.selftext); if (matchedKws.length > 0) { leads.push({ id: getLeadId(post.data.url), source: "r/CryptoMoonShot", author: post.data.author, content: post.data.title + "\n" + post.data.selftext, url: `https://reddit.com${post.data.permalink}`, painPoint: matchedKws[0] }); } } return leads; } Then function to scrape HN Who's Hiring: async function scrapeHN() { const query = "Who's Hiring"; const url = `https://hn.algolia.com/api/v1/search?query=${encodeURIComponent(query)}&tags=story&hitsPerPage=50`; const res = await fetch(url, { headers: HN_ALGOLIA_KEY ? { "X-Algolia-API-Key": HN_ALGOLIA_KEY } : {} }); const data = await res.json(); const leads = []; // Get the latest Who's Hiring thread const hiringThread = data.hits.find(hit => hit.title.toLowerCase().includes("who's hiring") && hit.title.toLowerCase().includes("2024")) || data.hits[0]; if (!hiringThread) return leads; // Fetch comments in the hiring thread const commentsUrl = `https://hn.algolia.com/api/v1/items/${hiringThread.objectID}`; const commentsRes = await fetch(commentsUrl); const commentsData = await commentsRes.json(); for (const comment of commentsData.children) { if (comment.text) { const matchedKws = matchesKeywords(comment.text); if (matchedKws.length > 0) { leads.push({ id: getLeadId(comment.url || `https://news.ycombinator.com/item?id=${comment.id}`), source: "HN Who's Hiring", author: comment.author, content: comment.text, url: `https://news.ycombinator.com/item?id=${comment.id}`, painPoint: matchedKws[0] }); } } } return leads; } Then function to scrape Discord public channel: async function scrapeDiscord() { if (!DISCORD_CHANNEL_ID || !DISCORD_BOT_TOKEN) { console.log("Skipping Discord: missing DISCORD_CHANNEL_ID or DISCORD_BOT_TOKEN env vars"); return []; } const url = `https://discord.com/api/v10/channels/${DISCORD_CHANNEL_ID}/messages?limit=100`; const res = await fetch(url, { headers: { "Authorization": `Bot ${DISCORD_BOT_TOKEN}` } }); if (!res.ok) { console.log(`Discord fetch failed: ${res.status}`); return []; } const messages = await res.json(); const leads = []; for (const msg of messages) { const matchedKws = matchesKeywords(msg.content); if (matchedKws.length > 0) { leads.push({ id: getLeadId(msg.url), source: "Web3 Founder Discord", author: msg.author.username, content: msg.content, url: msg.url, painPoint: matchedKws[0] }); } } return leads; } Then function to save leads: async function saveLeads(leads) { let existingLeads = []; if (fs.existsSync('leads.json')) { existingLeads = JSON.parse(fs.readFileSync('leads.json', 'utf8')); } const existingIds = new Set(existingLeads.map(l => l.id)); const newLeads = leads.filter(l => !existingIds.has(l.id)); const allLeads = [...existingLeads, ...newLeads]; fs.writeFileSync('leads.json', JSON.stringify(allLeads, null, 2)); console.log(`Saved ${newLeads.length} new leads, total leads: ${allLeads.length}`); return allLeads; } Then function to generate DM: function generateDM(lead) { return `Hey ${lead.author}, saw your post in ${lead.source} about ${lead.painPoint} — we built a fully custom real-time pipeline that fixes broken social scrapers, tracks on-chain whale moves and sentiment, and sends instant Slack/Discord alerts before they tank your token price. No new tools required, no maintenance work from your team. Want to test it free for 24 hours for your token? No credit card needed, just reply here to set it up.`; } Then main function: async function main() { const command = args[0]; if (command === "--scrape") { console.log("Starting lead scraping..."); const redditLeads = await scrapeReddit(); const hnLeads = await scrapeHN(); const discordLeads = await scrapeDiscord(); const allLeads = [...redditLeads, ...hnLeads, ...discordLeads]; await saveLeads(allLeads); } else if (command === "--generate-dm" && args[1]) { if (!fs.existsSync('leads.json')) { console.log("No leads.json found, run --scrape first"); process.exit(0); } const leads = JSON.parse(fs.readFileSync('leads.json', 'utf8')); const lead = leads.find(l => l.id === args[1]); if (!lead) { console.log("Lead not found"); process.exit(0); } console.log("Generated DM copy:"); console.log("-------------------"); console.log(generateDM(lead)); console.log("-------------------"); } else { console.log("Invalid command. Usage: node main.mjs --scrape | --generate-dm "); } process.exit(0); } main(); Wait that's perfect. Let's check: it's ESM, uses built-in modules (fs, crypto, url, fetch is built-in Node 18+), CLI works with --scrape and --generate-dm, uses process.env for all secrets, no placeholders, no TODOs, ends with process.exit(0). The top 5 line comment is there. Great. Now PRICE: "$349 one-time setup fee + $99/month for 24/7 uptime and alert monitoring" wait wait, the pitch says flat $349 one-time setup plus $99/month. So PRICE line is "$349 one-time + $99/month" that's fine, or more clear? Wait the example says e.g. "$49 one-time" or "$19/month", so "$349 one-time setup + $99/month" is okay. Then LANDING_COPY: Let's refine it to be under 200 words, no hype. Let's adjust: Seed-stage Web3 teams waste 5+ hours a week maintaining broken social scrapers and manually tracking whale moves, only to miss 10%+ token price drops from uncaught sentiment spikes or sudden sell-offs. Most off-the-shelf sentiment tools can’t bypass Cloudflare, don’t integrate on-chain data, and cost $500+ a month, out of reach for early-stage teams. What you get: - Fully custom real-time pipeline that scrapes