Welcome to use the XiaoZhi Backend Service (hereinafter referred to as "the Service"). The Service is designed to provide backend service support for XiaoZhi AI hardware devices, including but not limited to intelligent voice interaction, visual understanding, intent recognition, conversation memory, knowledge base Q&A, device management, and agent management. The operator of this Service is the actual deployer and administrator of the Service (hereinafter referred to as "Operator" or "we").
Before registering, logging in, or using the Service, please carefully read and fully understand all terms of this Agreement, especially the terms that are highlighted in bold and may have significant impact on your interests, including but not limited to disclaimers and liability limitations.
When you complete registration, login, or otherwise use the Service following the on-screen instructions, it signifies that you have fully read, understood, and accepted all contents of this Agreement. If you disagree with this Agreement or any of its terms, please stop using the Service immediately.
This Agreement may be updated and revised based on actual circumstances. The revised Agreement will be published through the Service's announcement mechanisms. The revised Agreement shall take effect from the date of publication. If you continue to use the Service after the Agreement revision, it shall be deemed that you have accepted the revised Agreement.
XiaoZhi Backend Service: refers to the XiaoZhi Backend Service and its backend service system, including but not limited to the Admin Console (management backend), API interfaces, WebSocket communication services, etc.
Admin Console: refers to the web management interface provided by the Service for device management, agent configuration, user management, and other functions.
User: refers to natural persons, legal persons, or other organizations who register or otherwise use the Service, hereinafter referred to as "you".
Intelligent Agent (Agent): refers to an AI character created and configured within the Service, containing a collection of capabilities such as language models, speech recognition, speech synthesis, visual understanding, intent recognition, conversation memory, and knowledge base.
Device: refers to ESP32 and other hardware devices connected and managed through the Service.
This Agreement is a legal agreement between you and the Operator regarding your use of the Service. This Agreement applies to all your actions when using the Service through the Admin Console or other means.
The source code of the Service follows the corresponding open-source license. This Agreement governs your use of the Service and does not affect the rights granted to you by the open-source license itself.
3.1 User Eligibility: You confirm that before using the Service, you should have the capacity for civil conduct as required by the laws of the People's Republic of China. If you are a minor, you should use the Service under the company and guidance of your legal guardian.
3.2 Account Registration: You may register and log in to the Service through mobile phone verification code, username/password, or other methods. You shall provide true, accurate, and complete registration information and update it promptly.
3.3 Account Security: You shall properly keep your account and password safe. All consequences arising from account leakage or unauthorized use by others due to your reasons shall be borne by you. If you discover any security risks with your account, please contact the Operator immediately.
3.4 Account Usage Restrictions: Your account is for your personal use only. Without the Operator's consent, you shall not transfer, rent, or lend your account to any third party in any way.
3.5 Account Cancellation: If you need to cancel your account, you may do so through the account settings in the Admin Console or contact the Operator for processing. After account cancellation, related data will be deleted and cannot be recovered. Please proceed with caution.
4.1 Service Overview: Relying on artificial intelligence technology, the Service provides intelligent interaction services for connected hardware devices through API calls to third-party generative AI models, including but not limited to Voice Activity Detection (VAD), Automatic Speech Recognition (ASR), Large Language Model (LLM), Text-to-Speech (TTS), Vision Large Language Model (VLLM), Intent Recognition, Conversation Memory, and Retrieval-Augmented Generation (RAG).
4.2 Agent Management: You can create and configure Agents through the Admin Console, including setting role templates, selecting language models, configuring voice parameters, setting intent recognition rules, managing knowledge bases, enabling conversation memory, configuring Agent plugins, etc. The Agent settings shall not violate national laws and regulations.
4.3 Device Management: You can bind and manage your hardware devices through the Admin Console, perform device configuration, firmware updates, OTA remote upgrades, etc. You shall ensure that the devices you manage are lawfully owned or authorized by you.
4.4 Visual Understanding: The Service supports image capture through device cameras and uses third-party vision models for image recognition and scene understanding. You shall ensure that image capture complies with relevant laws and regulations and does not infringe upon others' privacy.
4.5 Intent Recognition: The Service can understand the intent of user commands through intent recognition and trigger corresponding operations or services, such as controlling smart devices, querying information, etc.
4.6 Conversation Memory: The Service can record and store summaries of your interaction history with the Agent to provide more coherent and personalized interaction experiences in subsequent conversations. You can manage or clear memory data in the Admin Console.
4.7 Knowledge Base: The Service supports uploading documents, texts, and other content to build knowledge bases. Agents can retrieve knowledge base content during conversations to provide Q&A services. You shall ensure that uploaded knowledge base content does not infringe upon third-party intellectual property rights and does not contain content that violates laws and regulations.
4.8 Voice Print Recognition: The Service supports voice print recognition. You can register voice print samples to achieve speaker identity verification and personalized services. Voice print data will be used for identity verification purposes.
4.9 Voice Cloning: The Service supports voice cloning. You can clone custom voice timbres by providing audio samples. Cloned voices are for your personal use only and shall not be used to impersonate others or engage in illegal activities.
4.10 MCP Endpoints: The Service supports MCP (Model Context Protocol) and can serve as an MCP Server to provide tool calling capabilities to external systems, or as an MCP Client to call external MCP services, achieving standardized integration with external systems.
4.11 Context Providers: the Service supports Context Provider functionality, which can obtain real-time information from external data sources, such as weather, news, stocks, etc., providing Agents with richer knowledge sources.
4.12 MQTT Protocol: The Service supports MQTT (Message Queuing Telemetry Transport) protocol for message communication between IoT devices. You can use the MQTT protocol to send device control commands, monitor device status, etc.
4.13 Service Disclaimer: The conversations and responses generated by third-party AI models that the Service depends on are for reference only and do not constitute professional advice in any field. You shall not use the output content as professional advice in medical, legal, financial, or other professional fields. Any judgments or decisions you make based on the output content shall be entirely at your own responsibility.
4.14 Service Fees: The Service is a free open-source project and does not charge any usage fees from users. It only provides platform capabilities for calling third-party services and does not involve any paid functions or value-added services.
The Service supports multiple AI service providers with different billing models as follows:
(1) Free Services: Some service providers offer free quotas or completely free services, such as Zhipu AI (free models like glm-4-flash), Microsoft EdgeTTS voice synthesis, etc.
(2) Pay-as-you-go: Some service providers charge based on API usage, such as OpenAI, Alibaba Cloud Intelligent Speech, Baidu Wenxin, iFlytek, etc. You need to pay the corresponding fees to third-party service providers yourself. Such fees are unrelated to this Service.
(3) Local Deployment: The Service supports fully local AI deployment solutions, such as FunASR speech recognition, FishSpeech voice synthesis, Ollama local large models, etc. Local deployment does not require network fees or API usage fees but requires sufficient local computing resources.
You can choose a suitable service provider based on your actual needs and budget. For specific fee standards, please refer to the official documentation of each service provider.
4.15 Service Changes: The Operator reserves the right to adjust, upgrade, or terminate the Service content based on actual circumstances and will endeavor to provide advance notice.
5.1 Legal Use: When using the Service, you shall comply with the laws and regulations of the People's Republic of China and relevant international treaties, and shall not use the Service for any illegal activities.
5.2 Prohibited Activities: You undertake not to engage in the following activities when using the Service:
(1) Publishing, transmitting, or storing content that endangers national security or social stability, including but not limited to content involving subversion of state power, damage to national honors and interests, incitement of ethnic hatred, etc.
(2) Publishing, transmitting, or storing content that infringes upon the legitimate rights and interests of others, including but not limited to infringement of intellectual property rights, privacy rights, reputation rights, etc.
(3) Publishing, transmitting, or storing obscene, pornographic, violent, terrorist, or content that incites crimes.
(4) Publishing false information, spreading rumors, or engaging in fraudulent activities.
(5) Interfering with the normal operation of the Service in any way, including but not limited to attacking servers, spreading malicious programs, malicious consumption of system resources, etc.
(6) Reverse engineering, decompiling, or otherwise attempting to obtain the source code of the Service without authorization (this clause does not limit your lawful use of open-source code under the open-source license).
(7) Using the Service for automated batch operations, malicious consumption of API call quotas or other system resources.
(8) Inputting content that violates laws and regulations or public order and good morals in Agent settings.
(9) Using the Service to harm or attempt to harm minors.
(10) Other activities that violate laws and regulations, this Agreement, or may harm the legitimate rights and interests of the Operator and third parties.
5.3 Handling of Violations: If you violate the above conduct standards, the Operator has the right to take measures such as warnings, feature restrictions, service suspension, account banning, etc., depending on the severity, and reserves the right to pursue legal liability.
6.1 Open-source License: The Service is an open-source project, and its source code follows the corresponding open-source license. You may use the relevant source code in compliance with the terms of that license.
6.2 Service Content Ownership: Except for open-source code, the interface design, icons, copy, and other independently created content by the Operator in the Service are owned by the Operator.
6.3 User Content: The intellectual property rights of content you input, upload, or generate through the Service shall be determined according to relevant laws and regulations. You grant the Operator the right to store and process your input content for the purpose of maintaining and improving the Service.
6.4 Third-party Rights: You shall respect the intellectual property rights and other legitimate rights of third parties when using the Service. You shall bear full responsibility for any disputes arising from your infringement of third-party rights.
7.1 Information Collection: To provide the Service, the Operator may collect your registration information (such as phone number, username), device information, usage logs, etc. For specific personal information collection and usage rules, please refer to the Privacy Policy.
7.2 Information Protection: The Operator will take reasonable technical and management measures to protect the security of your personal information. However, due to the openness of the Internet, the Operator cannot absolutely guarantee information security. Please pay attention to protecting your sensitive personal information.
7.3 Information Security Warning: Please do not disclose sensitive personal information such as your property accounts, bank card numbers, passwords, etc. to the AI during your use of the Service. Any losses resulting from this shall be borne by you.
8.1 AI-Generated Content: The Service relies on third-party AI models to provide intelligent interaction capabilities. The content generated by AI may be inaccurate, incomplete, or inappropriate. The Operator does not make any guarantees regarding the authenticity, accuracy, or completeness of AI-generated content.
8.2 Service Interruption: The Operator shall not be responsible for service interruptions or abnormalities caused by the following reasons:
(1) Force majeure factors such as natural disasters, epidemics, wars, etc.
(2) Public service factors such as power supply failures, communication network failures, etc.
(3) Service failures or policy adjustments of third-party AI model service providers.
(4) Temporary service interruptions caused by system maintenance or upgrades.
(5) Cybersecurity events such as hacker attacks, computer viruses, etc.
(6) Service adjustments due to laws, regulations, or government control.
(7) Other situations not caused by the Operator's fault.
8.3 Third-party Services: The Service may involve third-party services such as language models, speech recognition, speech synthesis, vision models, intent recognition, etc. You shall also comply with the terms of third parties when using them. For issues arising from third-party services, please contact the third party directly.
8.4 Open-source Statement: The Service is an open-source project provided "as is". To the maximum extent permitted by law, the Operator does not make any express or implied warranties regarding the merchantability, fitness for a particular purpose, or non-infringement of the Service.
8.5 Open-source Software Special Statement: This project is open-source software. This Service does not have any commercial cooperative relationships with any third-party API service providers (including but not limited to platforms for speech recognition, large models, speech synthesis, etc.) and does not provide any form of guarantees for their service quality and fund security. This software does not host any account keys, does not participate in capital flow, and does not bear the risk of recharge fund losses.
8.6 Security Warning: The functions of this project are not complete and have not passed cybersecurity reviews. Please do not use them in production environments. If you deploy this project in a public network environment for learning purposes, you must take necessary protective measures, including but not limited to setting strong passwords, restricting access permissions, enabling HTTPS encrypted transmission, etc.
9.1 If you are a minor under 18 years of age, you should use the Service under the guidance and consent of your guardian.
9.2 Guardians should strengthen supervision of minors' use of the Service and guide them to use it reasonably to avoid over-dependence.
9.3 Minors should pay attention to personal information protection when using the Service and avoid uploading or disclosing sensitive personal information.
10.1 User Termination: You have the right to stop using the Service and cancel your account at any time.
10.2 Operator Termination: The Operator has the right to terminate providing services to you under the following circumstances:
(1) You violate the terms of this Agreement.
(2) You use the Service for illegal activities.
(3) Required by laws, regulations, or policies.
(4) The Operator decides to stop operating the Service.
10.3 Post-Termination Handling: After the Agreement is terminated, the Operator has no obligation to retain your account information and related data. The Operator still has the right to pursue your liability for breaches during the validity period of the Agreement.
11.1 The formation, effectiveness, interpretation, revision, termination, and dispute resolution of this Agreement shall be governed by the laws of the People's Republic of China.
11.2 Any disputes arising from this Agreement or the Service shall be resolved through friendly negotiation between both parties. If negotiation fails, either party has the right to bring a lawsuit to the people's court with jurisdiction over the Operator's location.
11.3 If any provision of this Agreement is determined to be invalid or unenforceable, it shall not affect the validity of the remaining provisions.
12.1 This Agreement constitutes the complete agreement between you and the Operator regarding your use of the Service.
12.2 The Operator's failure to exercise or delay in exercising any rights under this Agreement shall not constitute a waiver of such rights.