How the internet became searchable

Sdílet
Vložit
  • čas přidán 19. 06. 2024
  • The curious story of how a college student wrote a shell script and ended up changing the Internet. We take a look at the anonymous FTP search engine called Archie, and find out how it disappeared just as quickly as it arrived.
    Want more content like this? Support our mission! Send us a Super Thanks and check out our Patreon + Discord community: / serialport
    Got some retro gear you want to donate? Get in touch with us at serialport.org.
    Our second channel: ‪@TheParallelPort‬
    00:00 - Intro
    00:45 - Resource Discovery Problem
    02:27 - Mike Schwartz
    05:57 - The first search engine
    06:28 - Alan Emtage
    15:46 - The web emerges
    17:57 - Mission impossible
    18:37 - Outro
    #internet #technology #90s
    References and sources: docs.google.com/document/d/e/...
  • Věda a technologie

Komentáře • 98

  • @MarkyShaw
    @MarkyShaw Před 2 měsíci +155

    Anybody miss the explorative nature of the old net? Nowadays it seems like the paradigm has shifted to having too much information. Most of which is delivered to us whether we like it or not. At least the algorithm knows I love content like this. Thanks for helping us remember where we came from.

    • @tcscomment
      @tcscomment Před 2 měsíci +28

      it has shifted from explorative to exploitative

    • @jamescollier3
      @jamescollier3 Před 2 měsíci +2

      yeah, The Machine

    • @kazwat
      @kazwat Před 2 měsíci

      you should try using some distributed web tech! ipfs is a great protocol that needs applications and users

    • @jfbeam
      @jfbeam Před 2 měsíci +8

      To me, the "information overload" is born out of spammers and the SEO industry. It's made it difficult to find the things you're actually looking for.

    • @ScottPlude
      @ScottPlude Před 2 měsíci +15

      The "old net" was truly great. The "new internet" is either rotten due to corporate control or fake due to certain influences and AI bots. Nothing can be trusted, not even audio and video now. So sad.

  • @Thiesi
    @Thiesi Před 2 měsíci +50

    Wait - what?! After setting up your own dial-up ISP on period-correct hardware, you are now setting up an _Archie_ server?! Oh boy does this CZcams channel not disappoint and tickle me in all the right places!

    • @hthring
      @hthring Před 2 měsíci +2

      omg im pumped for this, i might even start my own anonymous ftp !

    • @Thiesi
      @Thiesi Před 2 měsíci +1

      @@hthring Be careful with that though - mine got constantly abused for distributing stuff I probably wouldn't want to be associated with me until I disabled anonymous _downloads_ (not uploads though).

    • @hthring
      @hthring Před 2 měsíci +2

      @@Thiesi wouldn't it make more sense to have anonymous downloads but not uploads?

    • @Thiesi
      @Thiesi Před 2 měsíci

      @@hthring No, because I want those evil evilists to waste their time and bandwidth. Admittedly, that's not that big of an issue anymore nowadays, but I've been running my FTP server for literally decades now.
      Also, maybe someone does upload something useful at some point. (Not that that has ever happened though.)

  • @binarybear9711
    @binarybear9711 Před 2 měsíci +3

    Oh boi,
    this technology journey is stunning for a young person like me (24yo). For me the Internet started to take place in my Life with Windows XP and 1k dialup...😅
    Todays I even feel "Special" when I can Talk about IDE, floppy disks and the time when you got to disconnect from the internet, because of mom wants to call somebody 😂

  • @jonathanplevine
    @jonathanplevine Před 2 měsíci +4

    I used to work with Alan at Bunyip. Good times! At some point I was working on a prototype for a product that was basically the same idea as Amazon in its earliest form. Then some new VP came in and said: This is stupid, no one is ever going to _buy_ things on the internet. Shut it down.

  • @imadcom2010
    @imadcom2010 Před 2 měsíci +32

    Great channel, I have been working in technology for over 2 decades and every time I watch this channel I learn something new.

  • @bitegoatie
    @bitegoatie Před 2 měsíci +18

    It's hard to believe no one kept up the technology for the extant FTP servers out there, just for the sake of doing it. People maintain all sorts of old tech as a hobby, as a curiosity. Given how important Archie was - and it was, as you say - that it has completely vanished is just atypical and, to overstate it just a bit, astounding.

    • @Invenciblemario
      @Invenciblemario Před 2 měsíci +1

      Lots of maintenance work including responding to dmca takedowns. Same as a normal search engine.

  • @iGrave
    @iGrave Před 2 měsíci +12

    Ooh a cliffhanger! You tease :)
    Can't wait

  • @mx338
    @mx338 Před 2 měsíci +14

    Amazing little documentary, can't wait for the next part.

  • @AWalYT
    @AWalYT Před 2 měsíci +8

    I was super young (just barely in my teens) when I found out about Archie. Crazy to see it talked about here all these years later...It was definitely a tool of it's time...

  • @ScottPlude
    @ScottPlude Před 2 měsíci +7

    I really enjoyed this video. I just wish I had friends that also enjoyed content like this. I have family that lives with their faces glued to their iPhones and customers that pay me to know "nerd stuff" so they don't have to be bothered by anything technical.
    Thanks for making this video!

  • @compu85
    @compu85 Před 2 měsíci +11

    The production quality of this presentation is fantastic! Looking forward to part two!

  • @sh0ckwaveVR6
    @sh0ckwaveVR6 Před 2 měsíci +6

    I'm from Quebec and I had no idea that the first Search engine was invented at McGill! Wow can't wait to see the next video! This is fascinating

  • @KaldekBoch
    @KaldekBoch Před 2 měsíci +7

    I used Archie from Australia using a 1200 baud modem in the very early 1990s, but I was very young and had no idea what was really going on! I recall we dialled into Monash University, or perhaps Latrobe.
    Of course, we downloaded ASCII porn. 12 year olds gonna 12 year old I guess.

  • @kevinstatz
    @kevinstatz Před 2 měsíci +3

    These videos are so good. I always learn something new. The Serial Port crew has serious talent in presenting content like this. Taking the extra step and tying in a project or working demo makes it even more engaging.
    I'm only 31 so my earliest memories of the internet and search engines are rooted in the mid 90s. Part of the fun for me is learning about technologies from before i was even alive that make the Internet as we know it today possible.

  • @pjbeardsley
    @pjbeardsley Před 2 měsíci +6

    I remember Archie!!! As a college student in the early 90s and was fortunate enough to experience this transformation. Thank you for capturing this history, love the channel.

  • @boblister6174
    @boblister6174 Před 2 měsíci +14

    Sadly this video makes me realize how long I've been on the net I remember using this. Good information for people that never had access in the early 90's.(legitimate or not)

  • @danyay
    @danyay Před 2 měsíci +10

    Face reveal video! Love this channel, great video. Keep it up!!

  • @greatquux
    @greatquux Před 2 měsíci +5

    Nice, great interviews with people who were there, and looking forward to the server being up. Gonna join a Patreon level just for this!

  • @info-saturation
    @info-saturation Před 2 měsíci +9

    This was utterly fascinating, thank you for making this

  • @jj74qformerlyjailbreak3
    @jj74qformerlyjailbreak3 Před 2 měsíci +1

    The Name of this Channel alone deserves a Subscription

  • @LB4FH
    @LB4FH Před 2 měsíci +5

    Nice to see and hear this part of the internet history 👍🏻 Also, I love seeing the old internet map with the only non-US nodes being Norway and London

  • @ImpiantoFacile
    @ImpiantoFacile Před 2 měsíci +8

    Love all your videos. The production quality is amazing.

  • @Leftylove22
    @Leftylove22 Před 2 měsíci +1

    Absolutely great video! I love this channel.

  • @ahbailglail
    @ahbailglail Před 2 měsíci +3

    Amazing video! Awesome you got to interview Alan

  • @BigMacIIx
    @BigMacIIx Před měsícem

    I''m feeling so old now remembering connecting on the RISQ network with a 1200baud modem for searching warez with Archie.

  • @astacc
    @astacc Před 2 měsíci

    Thanks for making all these great videos. Without this, I don't think I would ever even think of researching this much about early internet

  • @Seanbyford
    @Seanbyford Před 2 měsíci

    Randomly recommended this by CZcams…and I’m glad it was! Great content - having lived through the era or nothing to now - and also being a massive nerd; this is wonderful to watch

  • @easteregg8699
    @easteregg8699 Před měsícem

    is just want to put out here, how much i love your content. all of this is just amazing !

  • @capybara5494
    @capybara5494 Před 2 měsíci +4

    Holy shit that was awesome i’m so pumped

  • @bigMax1337
    @bigMax1337 Před 2 měsíci +1

    I love how this basically becomes a how to on how to build up a parallel internet. I think there is something amazing about having your own infrastructure and independence for large companies.

  • @JamesBos
    @JamesBos Před 2 měsíci

    This was wonderful. Thank you! 😊

  • @patteahan8704
    @patteahan8704 Před 2 měsíci +2

    Super cool. Can't wait for the follow up

  • @NotStoopid0228
    @NotStoopid0228 Před 2 měsíci +1

    Keep up the great work

  • @josephk6373
    @josephk6373 Před 2 měsíci

    wow, so cool excellent content every time!

  • @Phillip3223
    @Phillip3223 Před 2 měsíci +2

    The field of search engines is so much undervalued I feel. Thanks for creating this video, sharing some insights of the very start.
    As a fun note from my own experience: Hyperlinks are a double edged sword. They are the very building block a search engine may follow along, but there is so much noise. Or rather "DUST" (duplicate url same text)

    • @TheBardicDruid
      @TheBardicDruid Před 2 měsíci

      "The field of search engines is so much undervalued" If you think that, just try using your own search engine and watch how quickly and viciously Google comes after you, after all, they own every search engine on the internet.

  • @ScottPlude
    @ScottPlude Před 2 měsíci +1

    Thanks!

  • @JUSTforwhitlisting
    @JUSTforwhitlisting Před 2 měsíci +1

    As a Concordia graduate, interesting to see that search began at McGill

  • @audiocrush
    @audiocrush Před 2 měsíci +1

    What a cliffhanger! :D

  • @jfbeam
    @jfbeam Před 2 měsíci +2

    This was true before the explosive growth of the internet as well. BBS's weren't advertised on interstate billboards. It was very much a matter of who you knew. (and what they're willing to share.) To a much lesser degree, that sort of thing still exists. (The media likes to call it "The Dark Web".)

  • @Memerino-ly7yr
    @Memerino-ly7yr Před 2 měsíci +1

    Positively awesome

  • @mikemaldanado6015
    @mikemaldanado6015 Před 2 měsíci

    I used to use archie all the time but did not know the backstory, this was interesting. Thanks. btw my friends and i used to discover computers by each war dialing a subset of phone numbers every night. Surprisingly we discovered some interesting computers, some of them run by the govt. Most allowed anonymous ftp access back then....

  • @TeslaTales59
    @TeslaTales59 Před 2 měsíci +2

    How I remember those ftp searching days!
    One of the first GUIs was made by WRQ-
    Made it much easier? Does anyone remember that?

  • @edwardbyard6540
    @edwardbyard6540 Před 2 měsíci +1

    I miss the BBS and 90s internet days. I'm talking Usenet, CompuServe and maybe even Geocities era. No social media, no scams (well, maybe a bit of pump and dump stock fraud) but the internet today is a cess pit. It needs fixing, but how I do not know.

  • @lesfreresdelaquote1176
    @lesfreresdelaquote1176 Před měsícem

    Tant de souvenirs. So many memories

  • @protox07
    @protox07 Před 2 měsíci

    I like your videos

  • @NicholasAndre1
    @NicholasAndre1 Před 2 měsíci

    Ok I’m gonna call this out: your film frame border you used is tmax 3200 which is a high speed black and white film, not a color one 😂
    Alright I’ve concluded my pedantry. Amazing video btw.

  • @andrewmuller3514
    @andrewmuller3514 Před 2 měsíci

    🔥🔥

  • @evilborg
    @evilborg Před 2 měsíci +2

    I remember archie.....

  • @tsstsstsstsstsstss
    @tsstsstsstsstsstss Před 2 měsíci +3

    Woohooo!

  • @rweninger
    @rweninger Před 2 měsíci

    I still love FTP Servers. They are beautiful simple. I hate complex HTTP Portals they use nowadays. Happy at least in the bubble I am, more and more FTP's (secure) reappear.

  • @Neuer_Alias_erstellen
    @Neuer_Alias_erstellen Před 2 měsíci

    cool

  • @dcchillin4687
    @dcchillin4687 Před 2 měsíci

    Where would the world be without Altavista?

  • @mikehosken4328
    @mikehosken4328 Před 2 měsíci

    Early 90’s internet was the best

  • @iOMNetwork
    @iOMNetwork Před 2 měsíci

    Hey, I have an index of all files from all anonymous FTP server. its a 21 GB large file. Let me know if you need it. Imo its not really worth the effort of running a service like archie. There is no benefit in it since you cant ensure availability. It would be easier to load all the files and provide them in a google drive with unlimited space. As far as I can see there is no interesting stuff anymore besides backup files, huge map archives. And then there are files that can put u in troubles due to copyright stuff like movies.

  • @Sauceyjames
    @Sauceyjames Před 2 měsíci +1

    FTP is treated as a command prompt?? I was wondering why it was Impossible for me to download files 1995 and older on ftp websites.

    • @nickwallette6201
      @nickwallette6201 Před 2 měsíci +4

      Not exactly. It's a command-based protocol, but the FTP client is responsible for translating user input to server commands. So, it CAN be CLI... but it doesn't have to be. It just depends on the client software you use. Obviously, in the days of text-mode interfaces, it was used primarily through a command-line client.
      FTP and SMTP (email) are very similar in this way. The commands and responses are designed to be parsable by both humans and computers, and both present a session that you use commands to interact with. However, pretty much nobody interacts directly with an email server, while it's (relatively) common to use FTP interactively.
      There's nothing preventing you from using a terminal app to connect to an email server and read your email interactively. Likewise, browsers and other software can navigate an FTP session and grab a file without any further input.

    • @sophya5796
      @sophya5796 Před 2 měsíci

      Been ill since October and most days it just seems there's nothing to look forward to anymore. So grateful for this channel for trying to challenge that feeling 💔

  • @user-pe4bv7vm2y
    @user-pe4bv7vm2y Před 2 měsíci

    Anyone remember Gegereka?

  • @hotrodhunk7389
    @hotrodhunk7389 Před 2 měsíci +1

    Hash map

  • @virt1one
    @virt1one Před měsícem

    haha... @5:37 "you had thousands of hosts, hosting hundreds of GIGABYTES of data." no. Hundreds of MEGAbytes of data. Cool your jets, we're still saving files on 140kb 5.25" floppies about this time.

  • @mahtin
    @mahtin Před 2 měsíci

    ls -lR … the results aren’t dated back to the 80’s 😄

  • @brago.gameplays
    @brago.gameplays Před 2 měsíci

    Wellcone to the ftp saga

  • @dominick253
    @dominick253 Před 2 měsíci +1

    Surf the web man!

  • @alphago9397
    @alphago9397 Před 2 měsíci

    Of course .. it had to be one of the "un-intelligence agencies" ... lol

  • @cookiemikuchan
    @cookiemikuchan Před 2 měsíci

    silly title for the video considering search engines are now comprised of AI slideshows and advertisements instead of search results

  • @radicant7283
    @radicant7283 Před 2 měsíci

    Not anymore it's not