Skip to content
Registry StackDocsv0.25.0

Build and run a Registry Discovery index

View as Markdown

Use this guide when you operate a Registry Discovery catalog for known Evidence Gateway and Registry Relay providers. You maintain provider URLs and evidence-type mappings, build one immutable index on demand, then restart the read-only service with that index.

Use Registry Discovery to curate public advertisements from providers your catalog operator has already chosen to index. It is useful when an application must find an Evidence Gateway by evidence type, or a Registry Relay by its public semantics, before it performs its normal product-specific connection.

You need these inputs:

  • A provider-supplied public description URL, such as https://<provider-host>/catalog.jsonld. Record the URL out of band with the provider.
  • A local directory for the catalog project and a separate deployment directory for the index and runtime file.
  • The discoveryctl and discovery binaries.

The provider description uses the closed Registry Discovery JSON-LD profile. The profile is a selected alignment with Data Catalog Vocabulary (DCAT) 3, DCAT-AP 3.0.1, and BRegDCAT-AP terms. It does not claim complete DCAT-AP or BRegDCAT-AP conformance.

Create <discovery-project>/origins.yaml. Each enabled origin is fetched only during a build.

schemaVersion: registry-discovery/origins/v1alpha1
origins:
- originId: evidence-provider
catalogUrl: https://<provider-host>/catalog.jsonld
profile: registry-discovery-v1alpha1
enabled: true

Use a unique originId for each approved URL. Production origins use HTTPS. The --allow-loopback option exists only for a local development origin.

Create <discovery-project>/mappings/adult-status.yaml for each requirement that needs evidence-type resolution. A mapping can offer alternatives, but every ID in one alternative is required together.

schemaVersion: registry-discovery/evidence-mapping/v1alpha1
mappingId: urn:example:mapping:adult-status
mappingAuthorityId: urn:example:authority
requirementId: urn:example:requirement:adult-status
jurisdiction: urn:example:jurisdiction
alternatives:
- evidenceTypeListId: urn:example:list:adult-status
evidenceTypeIds:
- urn:example:evidence-type:adult-status

jurisdiction is optional. Use the same exact identifier in a resolve request when your mapping declares one.

Run the offline check before any build.

Terminal window
discoveryctl check --project "<discovery-project>"

Expected output reports the validated origin and mapping counts:

valid origins=1 mappings=1

The check reads the two authoring inputs but does not contact the provider URL.

Build into the deployment directory when the approved provider descriptions are available.

Terminal window
discoveryctl build \
--project "<discovery-project>" \
--output "<deployment-directory>/discovery-index.json"

Expected output reports independent semantic revisions:

built catalogRevision=sha256:<64-lowercase-hex-digits> mappingRevision=sha256:<64-lowercase-hex-digits>

The build fetches every enabled origin once, records the exact fetched-byte digest and fetch time, and records builtAt after every origin has been collected and the semantic revisions compile. The builder validates and syncs the complete file before replacing the active index, then syncs the deployment directory. Run the build again only when you intend to publish a new index revision.

Place this runtime.yaml beside discovery-index.json in the deployment directory.

schemaVersion: registry-discovery/runtime/v1alpha1
listener:
address: 127.0.0.1:8080
indexPath: discovery-index.json
limits:
maximumRequestBytes: 65536
maximumResponseBytes: 1048576
maximumResultRecords: 100
maximumResultAlternatives: 100
requestTimeoutSeconds: 10
shutdownTimeoutSeconds: 10
logLevel: info

Start the new revision after replacing the runtime directory contents.

Terminal window
discovery --runtime "<deployment-directory>/runtime.yaml"

The process remains running and serves the index named by the relative indexPath. Verify readiness from a network location that can reach the listener.

Terminal window
curl --fail-with-body "http://127.0.0.1:8080/ready"
{"status":"ready"}

The runtime accepts only its listener, relative index path, limits, and log level. It does not carry provider credentials, origin-fetch configuration, mappings, or application trust configuration. The runtime acquires one of four request-body permits before reading a body and holds the permit through request handling. It also rejects malformed percent escapes, invalid UTF-8 query values, duplicate media-type headers, and request media parameters other than UTF-8 JSON.

Resolve an application requirement to its evidence-type alternatives.

Terminal window
curl --fail-with-body \
-H 'Content-Type: application/json' \
--data '{"requirementId":"urn:example:requirement:adult-status","jurisdiction":"urn:example:jurisdiction"}' \
"http://127.0.0.1:8080/v1/evidence-types/resolve"

The response contains mappingRevision and the configured alternative with its mapping authority.

{"requirementId":"urn:example:requirement:adult-status","jurisdiction":"urn:example:jurisdiction","mappingRevision":"sha256:<64-lowercase-hex-digits>","alternatives":[{"evidenceTypeListId":"urn:example:list:adult-status","evidenceTypeIds":["urn:example:evidence-type:adult-status"],"mappingId":"urn:example:mapping:adult-status","mappingAuthorityId":"urn:example:authority"}]}

Search the catalog for a public Evidence Gateway advertisement. Copy the selected recordId, endpointUrl, and origin provenance from the result into your application selection record.

Terminal window
curl --fail-with-body --get \
--data-urlencode 'serviceKind=evidence' \
--data-urlencode 'evidenceType=urn:example:evidence-type:adult-status' \
"http://127.0.0.1:8080/v1/services"

The response has a catalogRevision and an items array. Each item carries the provider endpoint, its advertised capability IDs, and the origin URL, content digest, and fetch time.

For Registry Relay, use serviceKind=relay and one or both of semanticClass and operationFamily as repeated query filters. A protected-only Relay can advertise neither public semantic class nor operation family.

Discovery selection is metadata only. Before an application creates a native request, use its own Evidence Gateway or Registry Relay trust configuration to accept or reject the selected provider, then invoke the selected endpointUrl directly with that product’s native client. Do not send credentials or native request data to Registry Discovery.

SymptomCauseFix
discoveryctl check failsThe origins or mapping document is not in the closed authoring shape.Correct the schema version, identifiers, and duplicate values, then run the offline check again.
discoveryctl build failsAn enabled provider URL could not be fetched safely or did not return the exact profile media type.Confirm the URL with the provider and its public description deployment. Keep the previous index running until a complete build succeeds.
A search returns no itemsThe index contains no advertisement that matches every supplied filter.Inspect the advertised capability IDs and use a narrower or correct filter set.
Native connection is refusedThe application did not accept the selected provider under its local product trust configuration.Resolve the native Evidence Gateway or Registry Relay trust decision before retrying the direct connection.