{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "### Simple web scraper\n", "***\n", "Note: \n", ">*Check out http://datascience.ibm.com/blog/markdown-for-jupyter-notebooks-cheatsheet/*
\n", ">*Introduction to Jupyter: https://www.youtube.com/watch?v=Rc4JQWowG5I*\n" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "# Modules or libraries get imported here in Python, Julia, and R #\n", "import re\n", "import requests\n", "from bs4 import BeautifulSoup\n", "import time" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Load a webpage into memory and parse it using Beautiful Soup" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [], "source": [ "lyriclink = 'https://www.nytimes.com/'\n", "#lyriclink = 'https://www.washingtonpost.com/'\n", "webpg = requests.get(lyriclink)\n", "\n", "soup = BeautifulSoup(webpg.content,\"lxml\")" ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [], "source": [ "#soup.findAll(text=re.compile('Irma'))" ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "The Word biden showed up 2 times!!\n" ] } ], "source": [ "count=0\n", "keyword = 'biden'\n", "for lyrics in soup.findAll(string=re.compile(keyword)):\n", " count+=1\n", "print(\"The Word \"+ keyword + \" showed up\",count,\"times!!\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "__For homework, modify the variables webpg and the keyword to scrape a different website for a different word then upload the modified code to the In-Class Assignment for Week01 on Brightspace.__" ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n", " \n", " \n", " \n", " The New York Times - Breaking News, US News, World News and Videos\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
\n", " \n", " Skip to content\n", " \n", " \n", " Skip to site index\n", " \n", "
\n", "
\n", "
\n", " \n", " SKIP ADVERTISEMENT\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", " \n", " \n", " \n", " \n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", " \n", " \n", " \n", " \n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Biden Approved a Big Oil Project. Now, He’s Cracking Down on Drilling.\n", "

\n", "
\n", "

\n", " President Biden’s decision to block drilling on millions of acres of Alaskan tundra was the latest in a series of aggressive conservation actions.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"Two\n", " \n", " \n", "
\n", "
\n", " \n", " Erin Schaff/The New York Times\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " In Escalation, Adams Says Migrant Crisis ‘Will Destroy New York City’\n", "

\n", "
\n", "

\n", " At a town hall meeting, Mayor Eric Adams of New York said that he did not “see an ending” to the migrant crisis and renewed his push for federal help.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " The governor of Texas has sent migrants to other states, but they’re a fraction of the number of migrants boarding buses.\n", "

\n", "
\n", "

\n", " 4 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " Nyc Mayor’s Office, Via Youtube\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " ‘The Devil They Know’: McConnell’s Health Issues Worry Democrats\n", "

\n", "
\n", "

\n", " Senator Mitch McConnell and his usual opponents are aligned on Ukraine, spending and impeachment as he faces mounting health scrutiny.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Former Speaker Nancy Pelosi said she had no concerns about Senator Dianne Feinstein’s ability to serve.\n", "

\n", "
\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"Senator\n", " \n", " \n", "
\n", "
\n", " \n", " Haiyun Jiang for The New York Times\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Peter Navarro Is Convicted of Contempt of Congress Over Jan. 6 Subpoena\n", "

\n", "
\n", "

\n", " Mr. Navarro is the second top adviser to former President Trump to be found guilty of contempt for defying the Jan. 6 committee.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " The prosecutor Fani Willis accused Jim Jordan of trying to obstruct her case against Donald Trump and his allies.\n", "

\n", "
\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Gov. Ron DeSantis and Vivek Ramaswamy called the Proud Boys’ sentences “excessive” and “wrong.”\n", "

\n", "
\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"Peter\n", " \n", " \n", "
\n", "
\n", " \n", " Kevin Dietsch/Getty Images\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " How Covid Affects the Heart\n", "

\n", "
\n", "

\n", " Three years into the pandemic, the short- and long-term risks are becoming more clear.\n", "

\n", "

\n", " 4 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Covid Cases Continue to Rise, but Experts Remain Optimistic\n", "

\n", "
\n", "

\n", " An uptick in hospitalizations and deaths persists, but the numbers are relatively low and new vaccines are around the corner.\n", "

\n", "

\n", " 4 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"A\n", " \n", " \n", "
\n", "
\n", " \n", " Getty Images\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Is it time to wear masks again? Experts recommended when and how to use them.\n", "

\n", "
\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Don’t get your next Covid booster quite yet. Here’s why.\n", "

\n", "
\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Ukrainians Embrace Cluster Munitions, but Are They Helping?\n", "

\n", "
\n", "

\n", " The weapons, banned by most countries over human rights concerns, are “not a magic wand,” but some Ukrainian troops say they are making a difference.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Russian officials said air defenses shot down two drones in and around one of the country’s largest military hubs.\n", "

\n", "
\n", "
\n", "

\n", "

\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"A\n", " \n", " \n", "
\n", "
\n", " \n", " Tyler Hicks/The New York Times\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Mattel’s Windfall From ‘Barbie’\n", "

\n", "
\n", "

\n", " The company’s approach has paid off to a degree that even the C.E.O. could hardly have believed possible.\n", "

\n", "

\n", " 8 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Toyota has dominated sales of hybrid cars, but has been slow to sell all-electric vehicles.\n", "

\n", "
\n", "

\n", " 7 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Shares in Apple fell following reports that China would bar government workers from using iPhones.\n", "

\n", "
\n", "

\n", " 7 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"An\n", " \n", " \n", "
\n", "
\n", " \n", " Pablo Delcan\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Hillary Clinton Goes Back to School, Teaching at Columbia\n", "

\n", "
\n", "

\n", " The former secretary of state is teaching a class at Columbia University and starting an institute on global decision-making. Donald Trump barely gets a mention.\n", "

\n", "

\n", " 6 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"Hillary\n", " \n", " \n", "
\n", "
\n", " \n", " Maansi Srivastava/The New York Times\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " The Great Read\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " The Orphans of Flight 723\n", "

\n", "
\n", "

\n", " A Vermont woman who lost her father in the 1973 plane crash in New England tracked down other children who were left behind.\n", "

\n", "

\n", " 15 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"Michelle\n", " \n", " \n", "
\n", "
\n", " Michelle Brennen lost her father in the crash of Flight 723 when she was 10 years old.\n", " \n", " \n", " Hilary Swift for The New York Times\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " The Victoria’s Secret Fashion Show Returns. But Not as You Knew It.\n", "

\n", "
\n", "

\n", " The lingerie brand introduced a feature-length film that was meant to be the final piece of its reinvention, our critic writes.\n", "

\n", "

\n", " 6 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"A\n", " \n", " \n", "
\n", "
\n", " \n", " Nina Westervelt for The New York Times\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", "
\n", " \n", "
\n", "
\n", " \"Baghramian\n", "
\n", "
\n", "
\n", " \"Baghramian\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", " \n", " Mustafah Abdulaziz for The New York Times\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " A Sculptor Breaks Through, Taking the Walls Down With Her\n", "

\n", "
\n", "

\n", " With powerfully alive new works at the Met and MoMA, the Iranian-born artist Nairy Baghramian embraces the canon, the better to take it apart.\n", "

\n", "

\n", " 8 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " Opinion\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"David\n", " \n", " \n", "
\n", "
\n", "

\n", " David French\n", "

\n", "

\n", " The Contagious Corruption of Ken Paxton\n", "

\n", "
\n", "

\n", " 6 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"An\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Frank Bruni\n", "

\n", "

\n", " Old Is Workable. Depravity Is a Dead End.\n", "

\n", "
\n", "

\n", " 9 min read\n", "

\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"Nicholas\n", " \n", " \n", "
\n", "
\n", "

\n", " Nicholas Kristof\n", "

\n", "

\n", " One of the Best Things We Can Do for Our Health Is Free — and Fun\n", "

\n", "
\n", "

\n", " 7 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Stephanie Muravchik and Jon A. Shields\n", "

\n", "

\n", " Republicans in Wyoming See Clearly What’s Happening\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Michelle Cottle, Ross Douthat, Carlos Lozada and Lydia Polgreen\n", "

\n", "

\n", " The Woke Burnout Is Real — and Politics Is Catching Up\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Andy Hong\n", "

\n", "

\n", " How Does an Older Person See the City? Take a Look.\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"Pamela\n", " \n", " \n", "
\n", "
\n", "

\n", " Pamela Paul\n", "

\n", "

\n", " The Problem With ‘Elites’ May Not Be What You Think It Is\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Craig Singleton\n", "

\n", "

\n", " Under the Radar, China Has a Military Mission\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Letters From Our Readers\n", "

\n", "

\n", " A Performance Review for President Biden\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Charles M. Blow\n", "

\n", "

\n", " Dignified Silence Lets Trump Play the Victim\n", "

\n", "
\n", "

\n", " 4 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " David Wallace-Wells\n", "

\n", "

\n", " Forests Are No Longer Our Climate Friends\n", "

\n", "
\n", "

\n", " 6 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Jessica Grose\n", "

\n", "

\n", " The Fight for Your Kids’ Brains Has Already Begun\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Ross Douthat\n", "

\n", "

\n", " James Bond Is Now ‘Woke’\n", "

\n", "
\n", "

\n", " 6 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Peter Coy\n", "

\n", "

\n", " How to Make American Health Care Cheaper and Better\n", "

\n", "
\n", "

\n", " 6 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Thomas B. Edsall\n", "

\n", "

\n", " Behold the Free Speech Chutzpah of the Republican Party\n", "

\n", "
\n", "

\n", " 10 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " David Firestone\n", "

\n", "

\n", " Alabama’s Leaders Know Exactly What They’re Doing\n", "

\n", "
\n", "

\n", " 5 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \n", " \n", " \n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " What’s in Our Queue? Rebecca Donner and More\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", " \"Natalie\n", " \n", "
\n", "
\n", "
\n", " \n", " \n", " \n", " Natalie Kitroeff\n", " \n", " \n", " Writing in Mexico City\n", " \n", " \n", "
\n", "
\n", "
\n", "

\n", " I’m The Times’s bureau chief for Mexico, Central America and the Caribbean.\n", "

\n", "

\n", " Here are five things I’ve been reading, watching, listening to and playing →\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " Book: ‘All the Frequent Troubles of Our Days’\n", "
\n", "
\n", "
\n", "

\n", " Rebecca Donner’s book tells the true story of a young American woman who became part of Germany’s underground resistance to the Nazis during World War II. I cried multiple times. My grandmother, a Jew, fled Berlin as a child. I read parts aloud to her when we were last together.\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " TV: ‘The Ultimatum: Queer Love’\n", "
\n", "
\n", "
\n", "

\n", " There is something about this Netflix dating show’s concept that is deeply lesbian, in the sense that lesbians (I am one) are known to decide to move in and create a life together after dating for approximately one day. It seemed like one of the first times the reality-television industrial complex really\n", " \n", " understood\n", " \n", " the true potential of lesbian drama.\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " Song: ‘Drink Water’\n", "
\n", "
\n", "
\n", "

\n", " I have to admit that Jon Batiste is married to one of my best friends, so I am biased. But this song is earwormy while also reminding you to hydrate, and who could say no to that combo? You listen to the song, you get it stuck in your head, you drink water. Repeat.\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " Game: Backgammon\n", "
\n", "
\n", "
\n", "

\n", " I’m sure there is strategy to this game, but I barely have one. I’m from the Philadelphia area, so I usually propose a game by asking an overconfident question — “Are you ready to get absolutely obliterated in backgammon?” — and my opponent, usually my wife, then beats me. Classic Philly sports vibe.\n", "

\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " Instagram: @samyoukilis\n", "
\n", "
\n", "
\n", "

\n", " I feel joy looking at the photos and videos that Sam Youkilis, a photographer and filmmaker, posts on Instagram. There’s a lot of unvarnished and deeply charming Italy content, and many scenes involving parents and children, lovers and food. The Mediterranean Sea is a star. This is my ASMR.\n", "

\n", "

\n", " \n", " \n", " See the account.\n", " \n", " \n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " \n", " \n", " \n", " Here are some more favorites:\n", " \n", " \n", " \n", "

\n", " \n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " 1 of 7\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
    \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
  • \n", "
    • \n", "
\n", "
\n", " Item 1 of 7\n", "
\n", "
\n", " \n", " \n", " 1 of 7\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " In Case You Missed It\n", " \n", " \n", " Top picks from The Times, recommended for you\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Advertisement\n", "

\n", " \n", " SKIP ADVERTISEMENT\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " More News\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Danny Masterson Is Sentenced to 30 Years to Life in Prison for 2 Rapes\n", "

\n", "
\n", "

\n", " The “That ’70s Show” actor was found guilty in May of raping two women in the early 2000s.\n", "

\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " 2 Senators Propose Bipartisan Framework for A.I. Laws\n", "

\n", "
\n", "

\n", " The effort by Senators Richard Blumenthal and Josh Hawley is the latest move by lawmakers to catch up with the rapidly evolving technology.\n", "

\n", "

\n", " 2 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " \n", " \"Danny\n", " \n", " \n", "
\n", "
\n", " \n", " Chris Pizzello/Associated Press\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " Coco Gauff to Play Karolina Muchova for Spot in U.S. Open Women’s Final\n", "

\n", "
\n", "

\n", " Gauff, 19, is one match win away from making the U.S. Open singles final for the first time in her career.\n", "

\n", "

\n", " 3 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "

\n", " 4th Top FTX Executive Pleads Guilty Ahead of Sam Bankman-Fried Trial\n", "

\n", "
\n", "

\n", " Ryan Salame pleaded guilty to charges linked to the sweeping fraud case against Mr. Bankman-Fried, the founder of the cryptocurrency exchange.\n", "

\n", "

\n", " 4 min read\n", "

\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " Well\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Advertisement\n", "

\n", " \n", " SKIP ADVERTISEMENT\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " From the Book Review\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", " \n", " Review\n", " \n", "
\n", "

\n", " A Dishy Tell-All About Emily Weiss’s Glossier\n", "

\n", "

\n", " Marisa Meltzer’s “Glossy” recounts the millennial makeup company’s dewy rise and unglamorous plateau.\n", "

\n", "

\n", " 5 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"A\n", " \n", " \n", "
\n", "
\n", " \n", " Amy Lombard for The New York Times\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " Review\n", " \n", "
\n", "

\n", " Where Leftist Disdain Feeds Right-Wing Paranoia\n", "

\n", "
\n", "

\n", " In her latest book, “Doppelganger,” Naomi Klein investigates an online underworld of conspiracies and misinformation.\n", "

\n", "

\n", " 4 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"This\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " One Day, Yiyun Li Might Get Around to Reading Roald Dahl\n", "

\n", "
\n", "

\n", " The novelist and story writer’s new book is the collection “Wednesday’s Child.”\n", "

\n", "

\n", " 4 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"This\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " How Does a Best-Selling Author Name Her Characters?\n", "

\n", "
\n", "

\n", " Lisa Jewell puts a great deal of thought into the monikers she chooses for her books.\n", "

\n", "

\n", " 2 min read\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"In\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " The Athletic\n", " \n", " \n", " In-depth sports coverage of your favorite teams and leagues.\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " New York Times Cooking\n", " \n", " \n", " Recipes, advice and inspiration for any occasion.\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Advertisement\n", "

\n", " \n", " SKIP ADVERTISEMENT\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", " \n", " Recommendations From Wirecutter\n", " \n", " \n", " Independent reviews for thousands of products.\n", " \n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " New York Times Games\n", " \n", " \n", " Daily word and visual games, plus more.\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Wordle\n", "

\n", "
\n", "

\n", " Guess the 5-letter word with 6 chances.\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Wordle Review\n", "

\n", "
\n", "

\n", " Our columnist reviews the day’s puzzle. Warning: Contains spoilers!\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"An\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Connections\n", "

\n", "
\n", "

\n", " Group words that share a common thread.\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Spelling Bee\n", "

\n", "
\n", "

\n", " Subscribers can now play puzzles from previous days.\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " The Crossword\n", "

\n", "
\n", "

\n", " Get clued in with wordplay, every day.\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Letter Boxed\n", "

\n", "
\n", "

\n", " Create words using letters around the square.\n", "

\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", " \"\"\n", " \n", " \n", "
\n", "
\n", "
\n", "
\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "

\n", " Advertisement\n", "

\n", " \n", " SKIP ADVERTISEMENT\n", " \n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", "
\n", " \n", " \n", "
\n", "
\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "\n", "\n" ] } ], "source": [ "print(soup.prettify())" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.4" } }, "nbformat": 4, "nbformat_minor": 4 }