Show HN: Crul – Query Any Webpage or API
19 by portInit | 6 comments on Hacker News. Hi HN, we’re Carl and Nic, the creators of crul ( https://www.crul.com ), and we’ve been hard at work for the last year and a half building our dream of turning the web into a dataset. In a nutshell crul is a tool for querying and building web and api data feeds from anywhere to anywhere. With crul you can crawl and transform web pages into csv tables, explore and dynamically query APIs, filter and organize data, and push data sets to third party data lakes and analytics tools. Here’s a demo video, we’ve been told Nic sounds like John Mayer (lol) ( https://ift.tt/tbhg5Yw ) We’ve personally struggled wrangling data from the web using puppeteer/playwright/selenium, jq or cobbling together python scripts, client libraries, and schedulers to consume APIs. The reality is that shit is hard, doesn’t scale (classic blocking for-loop or async saturation), and comes with thorny maintenance/security issues. The tools we love to hate. Crul’s value prop is simple: Query any Webpage or API for free. At its core, crul is based on the foundational linked nature of Web/API content. It consists of a purpose built map/expand/reduce engine for hierarchical Web/API content (kind of like postman but with a membership to Gold's Gym) with a familiar parser expression grammar that naturally gets the job done (and layered caching to make it quick to fix when it doesn’t on the first try). There’s a boatload of other features like domain policies, scheduler, checkpoints, templates, REST API, Web UI, vault, OAuth for third parties and 20+ stores to send your data to. Our goal is to open source crul as time and resources permit. At the end of the day it’s just the two of us trying to figure things out as we go! We’re just getting started. Crul is one bad mother#^@%*& and the web is finally yours! Download crul for free as a Mac OS desktop application or as a Docker image ( https://www.crul.com ) and let us know if you love it or hate it. ( https://ift.tt/NfpV7wc ) And come say hello to us on our slack channel - we’re a friendly bunch! ( https://ift.tt/NZUTovz ) Nic and Carl ( https://ift.tt/37trgPk )
Show HN: Natural Language Git (Gitgpt)
14 by OddMerlin | 9 comments on Hacker News. Hey folks, Here's a quick and dirty tool to use natural language to get git to do what you want. Example: $gitgpt create a new branch called feature/test add all the files and commit with msg creating feature test then push to origin I haven't put it through the wringer yet, however it's worked well with some pretty straight forward day to day git usage.
Ask HN: I Need to Talk to Someone
79 by nas1throway | 28 comments on Hacker News. Laid off 6 months ago. Was on an H1-B visa. Moved to spouse’s dependent visa. I have just around year left on my H1-B and my previous employer was mid way through the PERM process when they laid me off. Most companies don’t want to hire me because of the delays in the processing of PERM these days since I have just a year left. And I just recently switched careers from construction to data. Feeling really hopeless and alone. My spouse has a good job, but this stress of not getting any work has been devastating to me. It took me around 8 months of job searching to find a role as a career switcher and now I’m back to square one in a bad market. I don’t have anybody I can talk to and just want to talk about my problems. I’m parked outside a Burger King parking lot in the car by myself and don’t have a clue on what I should do. Feeling hopeless.