Close Menu
Best in TechnologyBest in Technology
  • News
  • Phones
  • Laptops
  • Gadgets
  • Gaming
  • AI
  • Tips
  • More
    • Web Stories
    • Global
    • Press Release

Subscribe to Updates

Get the latest tech news and updates directly to your inbox.

What's On

Sonic Racing: CrossWorlds Preview – Rolling Around At The Speed Of Sound

8 June 2025

Gorgeous Hand-Drawn Metroidvania Constance Gets November Release Date On PC, 2026 For Consoles

8 June 2025

Owlcat Games Reveals The Expanse: Osiris Reborn

8 June 2025
Facebook X (Twitter) Instagram
Just In
  • Sonic Racing: CrossWorlds Preview – Rolling Around At The Speed Of Sound
  • Gorgeous Hand-Drawn Metroidvania Constance Gets November Release Date On PC, 2026 For Consoles
  • Owlcat Games Reveals The Expanse: Osiris Reborn
  • Bill Atkinson, Macintosh Pioneer and Inventor of Hypercard, Dies at 74
  • Fading Echo Is A Magical Puzzle Platformer With An All Star Cast, And It’s Launching Soon
  • Check Out System Shock 2: 25th Anniversary Remaster’s Multiplayer In New Gameplay Trailer
  • Get A New Look At Sleep Awake, A Psychedelic Horror Game From Blumhouse And Nine Inch Nails’ Robin Finck
  • Killer Inn Is Square Enix’s Take On Among Us
Facebook X (Twitter) Instagram Pinterest Vimeo
Best in TechnologyBest in Technology
  • News
  • Phones
  • Laptops
  • Gadgets
  • Gaming
  • AI
  • Tips
  • More
    • Web Stories
    • Global
    • Press Release
Subscribe
Best in TechnologyBest in Technology
Home » Good Search Borrows, Great Search … Steals?
News

Good Search Borrows, Great Search … Steals?

News RoomBy News Room20 June 20242 Mins Read
Share Facebook Twitter Pinterest LinkedIn Tumblr Reddit Telegram Email
Share
Facebook Twitter LinkedIn Pinterest Email

Web crawling—the act of indexing information across the internet—has been around for decades. It has primarily been used by search engines like Google and nonprofits like Internet Archive and Common Crawl to catalog the contents of the open internet and make it searchable. Until recently, the practice of web crawling has rarely been seen as controversial, as websites depended on the process as a way for people to find their content. But now crawling tech has been subsumed by the great AI-ening of everything, and is being used by companies like Google and Perplexity AI to absorb whole articles that are fed into their summarizing machines.

This week on Gadget Lab, WIRED senior writer Kate Knibbs joins the show to talk about web crawling and the controversy over Common Crawl. Then we talk with Forbes’ chief content officer and editor Randall Lane about how Perplexity.AI repurposed a Forbes article and presented it as its own story, without first asking permission or properly citing the source.

Show Notes

Read Kate’s story about how publishers are going after Common Crawl over AI training data. Read Randall’s story about how Preplexity.AI copied the work of two Forbes reporters.

Recommendations

Randall recommends his new horse racing league, the National Thoroughbred League. Kate recommends the book Victim by Andrew Boryga. Lauren recommends the show Hacks on Max.

Randall Lane can be found on social media @RandallLane. Kate Knibbs is @Knibbs. Lauren Goode is @LaurenGoode. Michael Calore is @snackfight. Bling the main hotline at @GadgetLab. The show is produced by Boone Ashworth (@booneashworth). Our theme music is by Solar Keys.

How to Listen

You can always listen to this week’s podcast through the audio player on this page, but if you want to subscribe for free to get every episode, here’s how:

If you’re on an iPhone or iPad, open the app called Podcasts, or just tap this link. You can also download an app like Overcast or Pocket Casts, and search for Gadget Lab. If you use Android, you can find us in the Google Podcasts app just by tapping here. We’re on Spotify too. And in case you really need it, here’s the RSS feed.

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
Previous ArticleVivo Y58 5G With 6,000mAh Battery, Snapdragon 4 Gen 2 SoC Launched in India: Price, Availability
Next Article How to fix a red light error on a motherboard

Related Articles

News

Bill Atkinson, Macintosh Pioneer and Inventor of Hypercard, Dies at 74

8 June 2025
News

Samsung Teases Z Fold Ultra, Bing Gets AI Video, and Nothing Sets A Date—Your Gear News of the Week

7 June 2025
News

The Best Backpacking Tents

7 June 2025
News

Security News This Week: The Mystery of iPhone Crashes That Apple Denies Are Linked to Chinese Hacking

7 June 2025
News

Tech Up Your Sourdough With These Upper-Crust Baking Gadgets

7 June 2025
News

Everything You Need to Know About MicroSD Express

7 June 2025
Demo
Top Articles

Costco partners with Electric Era to bring back EV charging in the U.S.

28 October 202495 Views

ChatGPT o1 vs. o1-mini vs. 4o: Which should you use?

15 December 202493 Views

5 laptops to buy instead of the M4 MacBook Pro

17 November 202466 Views

Subscribe to Updates

Get the latest tech news and updates directly to your inbox.

Latest News
Gaming

Check Out System Shock 2: 25th Anniversary Remaster’s Multiplayer In New Gameplay Trailer

News Room7 June 2025
Gaming

Get A New Look At Sleep Awake, A Psychedelic Horror Game From Blumhouse And Nine Inch Nails’ Robin Finck

News Room7 June 2025
Gaming

Killer Inn Is Square Enix’s Take On Among Us

News Room7 June 2025
Most Popular

The Spectacular Burnout of a Solar Panel Salesman

13 January 2025123 Views

Costco partners with Electric Era to bring back EV charging in the U.S.

28 October 202495 Views

ChatGPT o1 vs. o1-mini vs. 4o: Which should you use?

15 December 202493 Views
Our Picks

Bill Atkinson, Macintosh Pioneer and Inventor of Hypercard, Dies at 74

8 June 2025

Fading Echo Is A Magical Puzzle Platformer With An All Star Cast, And It’s Launching Soon

8 June 2025

Check Out System Shock 2: 25th Anniversary Remaster’s Multiplayer In New Gameplay Trailer

7 June 2025

Subscribe to Updates

Get the latest tech news and updates directly to your inbox.

Facebook X (Twitter) Instagram Pinterest
  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact Us
© 2025 Best in Technology. All Rights Reserved.

Type above and press Enter to search. Press Esc to cancel.