Skip to content

Repository

Component index

Every crate in xai-org/x-algorithm that touches For You distribution, grouped the way the README groups them.

Mixer

  • Home Mixer

    home-mixer/

    Builds For You. Owns pipeline stages, scoring weights, and calls out to Thunder, Phoenix, SimClusters, VF, and ads.

  • Candidate Pipeline

    candidate-pipeline/

    Framework Home Mixer sits on. Source, hydrator, filter, scorer, selector, side-effect stages. Parallel where it can.

Candidate sources

  • Thunder

    thunder/

    In-memory store of recent posts from accounts the viewer follows. The in-network candidate source.

  • Phoenix retrieval

    phoenix/

    Two-tower model. Viewer history embedding vs a semantic-ID post index. Returns nearest out-of-network posts.

  • SimClusters

    simclusters/

    Clusters accounts and posts by who engages with what, then retrieves by cluster overlap.

Retrieval index

  • Phoenix RankAll

    phoenix-rankall/

    Maintains the retrieval index as post events arrive.

  • RankAll Strato

    phoenix-rankall-strato/

    Event layer that picks an index shard after consulting visibility filtering.

Ranking

  • Phoenix ranking

    phoenix/

    Transformer that predicts per-action probabilities. Candidates cannot attend to each other. JAX train, Rust serve.

  • VM Ranker

    vm-ranker/

    Determinantal point process over embeddings. Trades a little score for less similarity between neighbors.

Content understanding

  • Grox

    grox/

    Publish-time classifiers for spam, adult, and violent media, plus numeric text/image representations. Prompts are not published.

  • Media model proxy

    media-model-proxy/

    Serves image and video models: adult, violence, hateful symbols, subject matter, known-media match.

  • CLIP

    clip/

    Trains the image/text embedding model the media classifiers consume.

  • Agatha

    agatha/

    Offline account labels from how others respond: blocks and reports relative to favorites, plus spam and adult flags.

  • BDSM

    bdsm/

    Sequence model over an account's actions. Looks for inauthentic or abusive behavior over time.

  • User cred v2

    user-cred-v2/

    PageRank over the follow graph and engagement edges. One reputation number per account.

Visibility

  • Visibility filtering

    visibility-filtering/

    Per (viewer, post): allow, interstitial, or drop. First matching drop wins. Separate rules for Home vs recommendations.

  • Scarecrow

    scarecrow/

    Applies label rules to live events. Embeds Botmaker as its engine.

  • Botmaker

    botmaker/

    Rule language, compiler, and runtime. Scarecrow loads bots from botmaker-rules/.

  • Abuse enforcement

    abuse-enforcement-service/

    Acts on model scores rather than events: label, challenge, or suspend.

  • Safety label user agg

    safety-label-user-agg/

    Rolls post labels up onto the account.

  • Under the Hood

    under-the-hood/

    Daily jobs that assemble the public label report: aggregates for an account and its posts over a month.

Index

Ara

A short briefing for this page — not the whole text.