Add everything-server for comprehensive MCP conformance testing #1587
+434
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
felixweinberger
force-pushed
the
fweinberger/conformance-everything-server
branch
6 times, most recently
from
9882e20 to
8c25177
Compare
felixweinberger
commented
Nov 6, 2025
Comment on lines
287
to
288
| # TODO(felix): Add public APIs to FastMCP for subscribe_resource, unsubscribe_resource, | ||
| # and set_logging_level to avoid accessing protected _mcp_server attribute. |
There was a problem hiding this comment.
some of these features aren't available via FastMCP yet; good reason to add this in a folllow-up PR...
felixweinberger
force-pushed
the
fweinberger/conformance-everything-server
branch
from
8c25177 to
22dcd3e
Compare
Implements a comprehensive reference server that exercises all MCP protocol features for conformance testing. This server validates that the Python SDK correctly implements the MCP specification by passing all 25 conformance test scenarios. Features implemented: - 11 tools covering all content types (text, image, audio, embedded resources, mixed content, logging, progress, error handling, sampling, elicitation) - 4 resources (static text/binary, templates, subscribable resources) - 4 prompts with various content types - Logging support (logging/setLevel) - Completion support (completion/complete) - Resource subscriptions (resources/subscribe, resources/unsubscribe) - Session management with StreamableHTTP transport Implementation uses FastMCP with proper type safety: - All URIs wrapped with AnyUrl() for type correctness - Context properly typed with ServerSession parameter - Subscribe/unsubscribe handlers use correct AnyUrl parameter and None return - Completion handler returns Completion objects - ElicitationResult uses discriminated union narrowing via action field - Relative imports in __main__.py to avoid type stub warnings Type checking: Passes pyright with 0 errors (only 3 targeted ignores for accessing _mcp_server private API, documented with TODO to add public APIs to FastMCP in the future). Conformance: Passes all 25 test scenarios.
felixweinberger
force-pushed
the
fweinberger/conformance-everything-server
branch
from
22dcd3e to
a2f030e
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Adds reference server implementing MCP protocol features for conformance testing.
Motivation and Context
Validates that the Python SDK correctly implements the MCP specification. Provides reference implementation for all features and enables regression testing of SDK changes.
How Has This Been Tested?
Passes all 25 conformance test scenarios (initialization, logging, completion, 11 tools, 6 resources, 5 prompts).
Breaking Changes
None.
Types of changes
Checklist
Additional context