Web scraping using Azure Synapse notebooks
- Maria Zakourdaev
- Mar 22, 2022
- 1 min read
A great business analysts are never saturated with data, they need more and more. Data analysis frequently calls for data enrichment, to enhance the dataset we already have by adding extra information. Data enrichment makes our data more useful and helps to get deeper insights. Sometimes this data may be internal company data, but in other situations we search for third party data over the internet such as historic sales data, market research data, product data, pricing data, etc.
It's great when we find the data available in a download format, however, from time to time we may need to scrape data directly from an HTML website. The technique of importing information from a website is called web scraping or data scraping.
Data Engineers have a lot of tools that can help with querying web data, such as Chrome plugins and Excel Power Query, but my favorite data manipulation tool is Python.
Read my blogpost on mssqltips.com to learn how to use Python and Azure Synapse notebook to scrape an HTML table ( <table> tag in HTML code ) from a web page directly into the DataFrame.
Have fun
Yours
Maria
Opened a few Panini packs hoping to pull something decent, and while the card designs look great, quality control can be hit or miss. Some packs had perfect prints, others had off-centering or small defects. The thrill of opening is fun, but getting a valuable pull definitely feels like a lottery. Had a redemption that took way longer than expected, so contacting https://www.pissedconsumer.com/company/panini-america/customer-service.html became the only option. The response wasn’t immediate, and the waiting game continued for a while, but eventually, the card showed up.
Been thinking about getting into Panini America cards, but I keep hearing mixed reviews. Some say the quality is top-notch, others mention issues with redemptions and damaged cards. Are their packs really worth the price, or is it a gamble? Also, if a card comes damaged or a redemption takes forever, how helpful is Panini America customer service?