Third-Party Risk ManagementNov 16, 202610 min read

What is an outside-in security assessment? How it works and where it stops

resources.items.outsideInAssessment.heroAlt
CR

CyberRank Research

Part of: Free Security Rating

An outside-in security assessment evaluates an organisation's cybersecurity and privacy posture using only information that is publicly observable from the internet, without access to its internal systems or cooperation from its staff. It is the method behind most security ratings, and it lets you assess any supplier quickly, including those that have not yet answered a questionnaire. CyberRank uses outside-in assessment to rate organisations from a domain name, on a scale from AAA to D.

TL;DR

  • Outside-in assessment uses public signals such as TLS, DNS, web pages, exposed services and breach data.
  • It is fast, repeatable and needs no vendor cooperation, but it cannot see internal controls.
  • Questionnaires, audits and penetration tests fill the gaps it leaves.
  • It is most useful for screening many vendors and for continuous monitoring between deeper reviews.
  • CyberRank's IISRI® External rating is an outside-in assessment; the IISRI® Internal method adds an on-site audit.

What is an outside-in security assessment?

An outside-in security assessment is a type of external security assessment that observes an organisation as an outsider would. The opposite, an inside-out assessment, examines systems and controls from within, with credentials and access.

It reads what the organisation's internet-facing systems publish and what third-party sources, such as breach databases, reveal about it. Each method below answers a different question, so mature programmes combine them. Our introduction to third-party risk management shows where each fits in the vendor life cycle.

Outside-in assessment compared with other assurance methods
Outside-in assessmentWhat it usesPublic signals: TLS, DNS, web content, exposed services, breach dataVendor effortNoneTypical timeMinutesHow CyberRank helpsRates any organisation from a domain, AAA–D
Security questionnaireWhat it usesThe vendor's own answers and evidenceVendor effortHighTypical timeWeeksHow CyberRank helpsQuestionnaire builder with evidence upload and expiry dates
Certification or attestationWhat it usesAn accredited auditor's or assessor's workVendor effortHighTypical timeMonthsHow CyberRank helpsDetects certifications such as ISO 27001 and SOC 2
Penetration testWhat it usesAuthorised attempts to exploit weaknessesVendor effortMedium to highTypical timeDays to weeksHow CyberRank helpsNot offered; complements the external layer
Inside-out auditWhat it usesInternal access, interviews, configuration reviewVendor effortHighTypical timeDaysHow CyberRank helpsIISRI® Internal method (on-site audit)

One platform for two layers

How CyberRank helps: CyberRank provides the outside-in layer and a questionnaire workflow in the same platform.

How does an outside-in security assessment work?

Most outside-in assessments follow five stages. The details vary by provider, so ask any provider to explain each stage.

The repeatability of stage 5 below is what distinguishes a rating from a one-off scan. A point-in-time assessment tells you about one day; continuous monitoring tells you when something changes. How CyberRank helps: CyberRank's methodology follows the same logic (observe, rate, score risk, combine) and reassesses monitored vendors nightly.

  1. Discover assets. Find the domains, subdomains and servers that belong to the organisation, often using DNS and public certificate records.
  2. Observe signals. Collect evidence from each asset: TLS configuration, email authentication records, security headers, exposed services, software versions, privacy notices, and mentions in breach or darknet sources. Each technical check is explained in our guide to what an external security scan checks.
  3. Rate findings. Classify each finding by severity, for example a missing DMARC record versus an exposed admin portal.
  4. Score risk. Turn findings into a risk score, sometimes adjusted for how important the organisation is to you.
  5. Combine and monitor. Combine area scores into one rating and repeat the assessment on a schedule, so the rating reflects change.

What can an outside-in assessment see, and what can it not see?

Being honest about visibility is what makes an outside-in assessment useful. It is strong evidence about the exposed layer and silent about the rest.

Visible and not visible from outside
TLS versions and certificatesNot visible from outsideInternal network segmentationHow CyberRank helpsChecks TLS and certificates on the main domain and subdomains
SPF, DKIM and DMARC recordsNot visible from outsideEndpoint protection and patch levels inside the networkHow CyberRank helpsChecks email authentication records
Exposed services and outdated public softwareNot visible from outsideAccess controls and privileged account managementHow CyberRank helpsScans public-facing assets with severity prioritisation
Privacy policy and cookie consentNot visible from outsideHow data is actually processed internallyHow CyberRank helpsAssesses privacy policies and consent banners
Domain and staff credentials in breach dataNot visible from outsideWhether leaked credentials were usedHow CyberRank helpsDetects leaked credentials and breach history
Published certificationsNot visible from outsideWhether certified controls operate day to dayHow CyberRank helpsDetects certifications and frameworks
Hosting location signalsNot visible from outsideContract terms and sub-processor agreementsHow CyberRank helpsShows hosting and data residency signals

Covering the internal column

If you need the internal column covered, you need internal evidence. For the practical side of the visible column, see our guide on how to check your company's security posture from the outside. How CyberRank helps: every CyberRank finding comes from the visible column, so each one can be traced to observable evidence.

How is it different from penetration testing and questionnaires?

Use outside-in assessment to screen and monitor, questionnaires to explain, and audits or tests to verify depth.

Penetration testing. A penetration test is an authorised attack simulation. NIST's SP 800-115 distinguishes between techniques that only observe and those that actively test or exploit. Outside-in ratings sit firmly on the observation side: they do not try to break in. That makes them safe to run on any organisation, and also less deep than a test.

Questionnaires. A questionnaire asks the vendor to describe its controls. It covers what an outside-in view cannot, such as governance, staff training and incident response, but the answers are self-reported and age quickly. Outside-in findings give you a way to check those answers: a vendor that claims strong email security but has no DMARC record deserves a follow-up question.

Certifications. An ISO/IEC 27001 certificate shows that an accredited body audited a management system at a point in time. It says little about whether a specific subdomain was patched last week.

How CyberRank helps: CyberRank can send questionnaires automatically to vendors whose rating falls below your baseline.

When should you use an outside-in assessment?

Outside-in assessment is most useful where speed, scale or independence matter.

Use cases for outside-in assessment
Pre-contract vendor screening (see security ratings in vendor due diligence)Why outside-in fitsResults in minutes, before the vendor engagesHow CyberRank helpsRates a new vendor from its domain
Tiering a large vendor listWhy outside-in fitsSame method for hundreds of vendorsHow CyberRank helpsCombines impact tier with breach likelihood into a risk level
Monitoring between annual reviewsWhy outside-in fitsDetects new exposures quicklyHow CyberRank helpsNightly reassessment with alerts on rating changes and new breaches
Checking your own postureWhy outside-in fitsShows what customers seeHow CyberRank helpsFree rating from a URL; free own-organisation assessment after registration
Fourth-party visibilityWhy outside-in fitsReveals suppliers' own suppliersHow CyberRank helpsShows fourth parties with ratings and a combined supply-chain risk
Board and management reportingWhy outside-in fitsOne comparable grade per vendorHow CyberRank helpsManagement Report and Cyber Risk Report

Where to start

If you are deciding where to begin with a long vendor list, our article on which vendors to review first covers prioritisation. Recurring checks are covered in our guide to how often vendors should be reassessed. How CyberRank helps: CyberRank supports each of these uses from the same outside-in data.

How to use outside-in assessments in your vendor programme

Decide what you will act on, assess before you contract, tier by impact, target your questions, monitor, share findings and record decisions.

Steps 2, 5 and the evidence collection in step 7 below can be automated; defining thresholds, tiering, follow-up and decisions are your team's process. How CyberRank helps: CyberRank automates assessment and monitoring and keeps rating history for your records.

  1. Define what you will act on. Decide which findings or grades trigger a follow-up, a questionnaire or an escalation.
  2. Assess before you contract. Run an outside-in assessment during vendor selection, not after onboarding.
  3. Tier by impact. Combine the rating with how critical the vendor is to you; a weak rating matters more for a payment processor than for a catering supplier.
  4. Ask targeted questions. Use findings to make questionnaires shorter and sharper.
  5. Monitor continuously. Watch for rating drops, new breaches and privacy-policy changes between reviews.
  6. Share findings with vendors. Give suppliers the evidence and a deadline; most external findings are quick to fix.
  7. Record decisions. Keep the rating, findings, follow-up and decision together as audit evidence.

How CyberRank runs an outside-in assessment

CyberRank's ratings are powered by the IISRI® methodology, which offers two methods. The CyberRank ratings page describes both.

Both lead to a rating from AAA to D with Security and Privacy sub-ratings. Additional signals include AI use (Beta) and quantum-crypto exposure (Beta). Anyone can run the free Cybersecurity & Privacy Rating without registering; full assessment details require an account.

  • IISRI® External (CyberRank): an automated, AI-driven assessment of public data that takes minutes and is non-invasive. It covers security testing, privacy testing, compliance detection, data leak and credential detection, and asset discovery across the main domain and its subdomains.
  • IISRI® Internal: an on-site audit with manual assessment and internal access, which takes two to five days and suits deep compliance work and audit preparation.

Where CyberRank does not help

CyberRank's external rating cannot see inside a vendor's network, endpoints, identity systems or backups, and it cannot judge governance, staff awareness or incident response maturity. It does not review contracts, decide whether a vendor is legally in scope of NIS2 or DORA, or report incidents to regulators. A rating is a posture indicator, not a certification, an audit opinion or a prediction of breaches. Fill these gaps with questionnaires, contractual clauses, audit reports, penetration tests and your own legal review.

Conclusion

An outside-in security assessment shows you what any organisation exposes to the internet: its encryption, email authentication, exposed services, privacy notices and breach history. It is fast, needs no vendor cooperation and can run continuously, which makes it the natural first layer of a vendor risk programme. It cannot see internal controls, so combine it with questionnaires, audits and tests for your most critical suppliers. CyberRank provides that first layer as a transparent AAA–D rating with nightly monitoring.

About this article

All text in this article reflects CyberRank's own perspective and is provided for general information. It is not legal advice. Product capabilities are described as of 16 November 2026; features marked Beta may change.

References

  1. NIST, SP 800-115: Technical Guide to Information Security Testing and Assessment (September 2008)
  2. NIST, Cybersecurity Framework (CSF) 2.0, Govern function, supply chain risk management category GV.SC (February 2024)
  3. ISO, ISO/IEC 27001:2022 (October 2022)
  4. CyberRank, Ratings and IISRI® methods (accessed 16 November 2026)

Frequently asked questions

See an outside-in assessment in action

Run the free Cybersecurity & Privacy Rating on any website and see what is visible from the outside.

See an outside-in assessment in action