Project

WeChat AI clone — LoRA fine-tuning

LLM fine-tuning · LoRA · Personal data pipeline

A chatbot that talks like me: I exported and cleaned my own WeChat chat history, converted it into instruction-tuning data, and LoRA-fine-tuned Qwen2-0.5B-Instruct so the model picks up my real texting style — phrasing, length, and habits included.

Qwen2-0.5B LoRA / PEFT Transformers Data engineering

Overview

Chat logs are messy: stickers, images, fragmented multi-message replies, and mixed contexts. The interesting part of this project is the data pipeline — decrypting and exporting the local WeChat database, filtering message types, merging consecutive messages into coherent question/answer turns, and formatting them as instruction–input–output JSON for supervised fine-tuning.

What I built

An end-to-end pipeline: chat-history extraction and cleaning, dataset construction and merging scripts, a LoRA fine-tuning run of Qwen2-0.5B-Instruct (tokenization, prompt templating with chat markup, masked labels), and a small inference app for chatting with the result.

Tech stack

Python · Hugging Face Transformers + PEFT (LoRA) · ModelScope for model download · pandas-style cleaning scripts · the open-source WeChatMsg toolkit for chat export.

Links

【待填写】Repo / demo screenshots.

Notes / Next steps

The 0.5B base keeps training cheap but limits coherence over long conversations; next steps are trying a larger base model, better turn segmentation for group chats, and quantified evaluation of "how much it sounds like me" beyond eyeballing the outputs.

← Back to projects