Core Companion

Core Companion adds an owner-bound AI companion to Minecraft. The companion can chat with the player, remember context, react to the world, use an inventory, perform survival tasks, show expressions, use optional voice/TTS/vision features, and perform Baritone-powered world actions.

The goal is to make the companion feel like a persistent character in your world instead of a simple pet or command bot. It can follow you, stay nearby, help with tasks, respond to events, manage items, run planner goals, build a relationship over time, and be customized through in-game settings.

Main Features

Spawn, remove, recall, locate, and auto-spawn your companion on login
Persistent owner-bound companion identity
Female and male companion setup options
Choose a start mode per world: bond with a partner immediately, or meet unbonded village companions and earn their trust through chat and food
Companion can be targeted by vanilla commands through its configured name or alias
Backpack and equipment inventory, with a companion inventory screen and a rotatable 3D companion preview
Item holding, equipment use, item transfer, dropping, depositing, and sorting behavior
Orb of Binding and bonded/unbonded spawn-egg support
Shoulder carry, dismount, hand-holding, player lead attach/release/pull, and paired emote state cleanup

AI And Chat

Core Companion supports normal chat responses and AI-assisted actions through the /corecompaion command.

/corecompaion ask — chat with your companion
Local-first and provider-flexible: runs on a local Ollama model by default, or connect any OpenAI-compatible endpoint (OpenAI, xAI/Grok, Gemini's OpenAI-compatible endpoint, LM Studio, llama.cpp server, and more)
Provider, endpoint, API key, and model are set in the in-game config screen
Configurable personality, history, temperature, token length, and response settings
Internal AI action directives for Baritone actions, planner goals, and social actions
Deterministic handlers for location, looked-at block questions/actions, hunger/eating, nearest village, sleep, "take me to base/farm," and social requests
Multiple AI action lines can be queued and processed

Direct Action Verbs

The companion supports many direct action commands and AI-triggered actions.

Control & status: stop, stay, recall, where, status
Modes: role, care_mode, combat_mode
Navigation: follow, surface, sleep_routine, explore, goto, goto_memory, go_home, go_farm, locations, locate_village
Memory: remember_location
Items & logistics: collect_items, eat, give_item, drop_item, inventory_intent, deposit_items, sort_inventory
Mining, combat & farming: mine, defend, attack_hostiles, hunt, harvest, replant
Building: place, preview_template, build_line, structures, build_template

Planner Automation

Deterministic planner automation for common survival tasks. Natural-language requests can map into plan queues, letting the companion perform multi-step jobs.

Current planner goals: get_wood, get_food, get_torches, farm_cycle, tend_remembered_farm, farm_cycle_deposit, prepare_mining_trip, prepare_toolkit, build_shelter, patrol_base, light_area, maintain_base, restock_base, wood_run, mining_expedition, return_and_deposit, torch_path.

Relationship perks can scale some planner supply amounts.

Social And Relationship Features

The interaction menu includes companion actions, task shortcuts, relationship options, and utility controls: inventory access, relationship screen, job board, structures menu, action queue, follow/stay/status/stop/clear-queue, sorting and deposit, guard/farm/patrol/torch/wood/mining presets, base and farm memory controls, role buttons, and social actions.

Built-in emotes: Wave, High five, Sit, Lean, Hug, Kiss.

Relationships build through conversation and feeding and progress through tiers — Stranger, Acquaintance, Friend, Close, Dating, Bonded — unlocking more social actions and warmer behavior:

Stranger / Acquaintance — reserved; basic actions and high five
Friend — lean, carry, hold hands; auto-defense and food help when you're hurt
Close — hug, kiss
Dating / Bonded — openly affectionate; hands you a golden apple when you are about to go down, and occasionally gives you a small gift

Some paired interactions only run when the companion state and player position allow them, preventing awkward or invalid animations.

Autonomy And Safety Modes

Role, care, and combat settings let the companion behave differently per situation.

Roles: Idle, Guard, Farmer, Miner, Hauler
Care modes: Passive, Balanced, Guard, Retreat, Full
Combat policy: Passive, Defend, Assist

She looks after herself and you: eats and drinks healing potions when low, auto-equips her best armor and draws her best weapon before a fight, retreats to you — or to a remembered base if you are far away — when badly hurt, and asks for food when she has none. A friendly companion can also take initiative, offering to make torches when it gets dark or fetch food when you are starving. If she dies, she leaves a recoverable spawn-egg keepsake so you can bring her back with the bond intact.

Memory And Awareness

Persistent memory can track player preferences, recent chats, events, deaths, mining, exploration, biomes, remembered bases/farms/coordinates, remembered plans, mood/current goal, and summaries.

World context can include dimension, position, biome, time, weather, light level, nearby entities, remembered places, sound/hearing context, and physical state. Her current mood influences behavior — a fragile mood makes her pull back sooner, while a protective mood makes her hold the line and guard you. She also reasons across recent events together, connecting them instead of reacting to each one in isolation.

Passive reactions can cover receiving items, hand-holding, carrying, social actions, player-lead events, damage, hunger, mining, building, combat, travel, idle moments, danger, and — with vision enabled — notable things she sees on screen.

Voice, Vision, And Client UI

Optional client-side features for voice, TTS, vision, HUDs, overlays, and rendering:

Voice input capture with local speech-to-text / whisper.cpp support
Text-to-speech playback using OpenAI or ElevenLabs voices (configured in-game)
Optional framebuffer vision capture through a local Ollama vision model, with on-demand capture and visual summaries fed into companion context
Status HUD, debug HUD, and Baritone path overlay
In-game config screen styled to match the vanilla menus, including an AI Providers section for endpoints, models, and API keys
Companion render layers for body shape, cat ears, tail, player-lead visuals, armor, and held items

Data And Extensibility

Built-in and config-loaded interaction packs
Built-in and config-loaded structure templates, plus bundled shelter/template data
Reload commands for packs and templates
Debug-gated tools for prompt dumps, Baritone status/failures, parity checks, expression testing, video scripts, and handhold recording

Privacy / AI Service Note

Core Companion is designed around user-configured AI services. Chat can run through a local Ollama model or any OpenAI-compatible endpoint you configure. Optional voice, text-to-speech, and vision features depend on the services the player configures. Using a cloud LLM or TTS provider sends your text (and, for vision, screenshot context) to that provider; running everything locally keeps it on your machine. Review your configuration before enabling these features.

Commands

Main command: /corecompaion

Subcommands: ask, spawn, remove, recall, where, help, setup female, setup male, start bonded, start village, carry, dismount, playerlead, reload. Additional debug and developer commands are available when debug options are enabled.

Requirements

Fabric API
GeckoLib
Mod Menu (optional — opens the in-game config screen)
A compatible Minecraft / Fabric version
Ollama (or another local model service) for local AI, or an OpenAI-compatible API key for cloud AI