Skip to main content
SGSiteGraph

scrapy.org

Scrapy — open source web scraping framework for Python

Last scanned Jul 27, 2026, 12:43 PM · 1 view

93

Overall score

Excellent

Summary

Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. This website uses Next.js hosted on AWS behind Vercel CDN. SEO is excellent (90/100) and accessibility is excellent (100/100). Security scores excellent (100/100) and performance good (85/100). Top issue: No structured data (JSON-LD) found.

Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.

United States
Hosted on AWS

Top issues to fix

1 issue found

  • No structured data (JSON-LD) found

    SEO

    Add JSON-LD (Organization, Article, Product…) to become eligible for rich results.

90

SEO

1 issue(s) found

85

Performance

23 ms

100

Security

HTTPS & header checks

100

Accessibility

0 issue(s) found

Not enough scan history yet to show a trend — check back after this site has been re-scanned a few more times.

Organization

Company details published in this site's own structured data.

Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.

Meta tags

Title
Scrapy — open source web scraping framework for Python
Description
Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.
Canonical
https://scrapy.org
Language
en
Charset
utf-8
Viewport
width=device-width, initial-scale=1
Robots meta
index, follow
Manifest

OpenGraph & Twitter Card

OpenGraph

og:title
Scrapy — open source web scraping framework for Python
og:description
Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.
og:type
website
og:url
https://scrapy.org

Twitter Card

twitter:card
summary_large_image
twitter:title
Scrapy — open source web scraping framework for Python
twitter:description
Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.

Technologies

Detected frameworks, languages, and tools.

Next.jsGoogle AnalyticsMeta Pixel

Hosting & CDN

Hosting provider
AWS
CDN provider
Vercel
IP address
76.76.21.164
ASN
AS16509 (AMAZON-02 - Amazon.com, Inc., US)

DNS records

TypeValue
A
  • 76.76.21.164
  • 66.33.60.34
AAAA—
MX—
TXT—
NS
  • ns1.vercel-dns-3.com
  • ns2.vercel-dns-3.com
  • ns3.vercel-dns-3.com
  • ns4.vercel-dns-3.com
CAA
  • 0 issue "sectigo.com"
  • 0 issue "letsencrypt.org"
  • 0 issue "pki.goog"
  • 0 issue "globalsign.com"
CNAME
  • cname.vercel-dns.com
IPv6 supportNo

TLS / SSL certificate

Version
TLS 1.3
Issuer
Let's Encrypt
Subject
www.scrapy.org
Valid from
Jul 18, 2026
Valid to
Oct 16, 2026
Days until expiry
81
SAN domains
www.scrapy.org

Security headers

  • Strict-Transport-SecurityEnabled
  • Content-Security-PolicyEnabled
  • X-Frame-OptionsEnabled
  • X-Content-Type-OptionsEnabled
  • Referrer-PolicyEnabled
  • Permissions-PolicyEnabled

Compression: gzip · 0 cookie(s) observed

Content & assets

Headings

H1 1 · H2 8 · H3 0

Links

8 internal · 9 external · 0 broken

Images

0 total · 0 missing alt

Scripts / Styles

43 scripts · 1 stylesheets

JS / CSS size

1.3 MB · 62.1 KB

Page size

119 KB

Robots.txt & Sitemap

robots.txt
Found
Disallow rules
0
sitemap.xml
Found
URLs in sitemap
5

SEO issues

  • No structured data (JSON-LD) found

Accessibility issues

No accessibility issues detected.

Scan details

Requested URL
https://scrapy.org
Final URL
https://www.scrapy.org/
HTTP status
200
HTTP version
HTTP/2
Response time
21 ms
HTML size
119 KB
Redirect chain
https://scrapy.org → https://www.scrapy.org/

See something wrong on this report? Request a correction

Related websites

Same technology stack

walmart.ca

Online Shopping Canada: Everyday Low Prices at Walmart.ca!

99
nextjsgoogle-analyticsmeta-pixel
AKAMAI-AS - Akamai Technologies, Inc., US

hcg.com

Huron | Global Consulting for Healthcare, Education, Digital & More

99
nextjsgoogle-analyticsmeta-pixel
AWS· Vercel

cline.bot

Cline - AI Coding, Open Source and Uncompromised

98
nextjsgoogle-analyticsmeta-pixel
AWS· Vercel

meilisearch.com

Meilisearch: Unified Search & AI Retrieval Platform

98
nextjsgoogle-analyticsmeta-pixel
Cloudflare· Cloudflare

acrisure.com

Insurance & Business Solutions from Acrisure

97
nextjsmeta-pixelgoogle-analytics
Cloudflare· Cloudflare

lhac.com

Hearing Aid Centers Across TX, NM, AZ, CO, OK & UT | Livingston Hearing Aid Center

97
nextjsmeta-pixelgoogle-analytics
AWS· Vercel

Same hosting provider

taronga.org.au

Taronga Conservation Society Australia | Taronga Zoo

100
AWS· Cloudflare

secureauth.com

SecureAuth | Continuous Identity Authority

100
google-analytics
AWS· Cloudflare

highereducation.com

Home - Higher Education

100
wordpressnextjs
AWS· Cloudflare

byside.com

Composable Digital Experience Platform | CoreMedia CMS

100
apachegoogle-analytics
AWS· CloudFront

surveyplanet.com

Free Online Survey Maker | Unlimited Surveys | Surveyplanet

100
google-analyticssvelte
AWS· CloudFront

petpooja.com

Software for Small and Medium Businesses | Petpooja

100
nginxgoogle-analytics
AWS· CloudFront

Frequently asked questions

What technology does scrapy.org use?
scrapy.org is built with Next.js, Google Analytics, Meta Pixel.
Is scrapy.org secure (HTTPS)?
Yes. scrapy.org uses TLS 1.3 with a certificate issued by Let's Encrypt, valid until Oct 16, 2026.
Who hosts scrapy.org?
scrapy.org is hosted on AWS, behind Vercel CDN.
What is scrapy.org's SEO score?
scrapy.org scored 90/100 for SEO in the latest analysis (excellent).
What is scrapy.org's overall website score?
scrapy.org has an overall SiteGraph score of 93/100, combining SEO, performance, security, and accessibility.