Blog chia sẻ kiến thức FPT Cloud

1. Overview This guide provides a comprehensive walkthrough for setting up and running distributed training using LLaMA-Factory on Metal Cloud (Bare Metal Server). We cover environment setup, Slurm-based job scheduling, and performance optimizations. Additionally, we include a training task using the Open Instruct Uncensored Alpaca dataset, which consists of instruction-tuning samples, for fine-tuning a Llama-3.1-8B model, with full fine-tuning settings on 4 nodes, 8 x NVIDIA H100 GPUs per node, providing hands-on instructions for replicating a real-world training scenario. The execution setting up a distributed training environment on Metal Cloud using Slurm, an open-source workload manager optimized for high-performance computing. The guide walks through: Preparing the infrastructure with Slurm, CUDA, and NCCL for efficient multi-GPU communication. Installing LLaMA-Factory and configuring the system to enable seamless model training. Running a fine-tuning task for the LLaMA-3.1-8B model using the Open Instruct Uncensored Alpaca dataset. Leveraging Slurm’s job scheduling capabilities to allocate resources and monitor performance efficiently. Key highlights that readers should focus on: Scalability & Efficiency: The guide demonstrates how Slurm optimally distributes workloads across multiple GPUs and nodes, reducing training time. Cost Optimization: Proper job scheduling minimizes idle GPU time, leading to better resource utilization and lower costs. Reliability: Automated job resumption, error handling, and real-time system monitoring ensure stable training execution. Hands-on Training Example: A real-world fine-tuning scenario is provided, including dataset preparation, YAML-based configuration, and Slurm batch scripting for execution. By following this guide, readers can replicate the training pipeline and optimize their own LLM training workflows on Metal Cloud. 2. Why Slurm for Distributed Training? Slurm is a widely used open-source workload manager designed for high-performance computing (HPC) environments. It provides efficient job scheduling, resource allocation, and scalability, making it an excellent choice for AI training on Metal Cloud. Key advantages include: Resource Efficiency: Slurm optimally distributes workloads across GPUs and nodes, minimizing idle resources. Scalability: Seamlessly scales from a few GPUs to thousands, accommodating diverse AI workloads. Job Scheduling: Prioritizes and queues jobs based on defined policies, ensuring fair usage of resources. 3. Use Case Use case: Training Large Language Models with LLaMA-factory One practical application of Slurm on Metal Cloud is training large language models using the LLaMA-factory framework. By distributing training across multiple GPUs and nodes, Slurm helps reduce training time while ensuring stable and efficient execution. Key Benefits: Scalability: Supports large-scale models with efficient GPU utilization. Cost Optimization: Reduces cloud computing costs by minimizing idle time. Reliability: Automated job resumption and error handling enhance workflow robustness. 4. Prerequisites Before proceeding, ensure you have the following: 4.1. System Requirements Metal Cloud access with multiple GPU-equipped nodes Slurm job scheduler installed and configured NVIDIA CUDA (11.8+ recommended) installed on all nodes NCCL (NVIDIA Collective Communication Library) for multi-GPU communication Python 3.8+ installed on all nodes Torch with distributed training support High-performance Storage 4.2. Network & SSH Configuration To enable seamless multi-node training, ensure: Each node can SSH into other nodes without a password using an SSH key. Network interfaces allow high-speed inter-node communication (e.g., InfiniBand). NCCL and PyTorch distributed backend can communicate over TCP/IP. You can verify node connectivity using: scontrol show nodes or sinfo 5. Environment Setup Assuming that you have all the system requirements for distributed training task, run the following on each compute node to install LLaMA-Factory. It will install all necessary packages to run LLaMA-Factory: [code lang="js"] python3 –m venv venv source venv/bin/activate git clone https://github.com/hiyouga/LLaMA-Factory.git cd LLaMA-Factory pip install –e “.[torch,metrics]” [/code] 6. Sample Training Task: Fine-Tuning LLaMA on Open Instruct Uncensored Alpaca Dataset To demonstrate a real-world scenario, we will full fine-tune a Llama-3.1-8B model using the Open Instruct Uncensored Alpaca dataset for instruction-following tasks. 6.1. Dataset: Open Instruct Uncensored Alpaca The Open Instruct Uncensored Alpaca is a collection of instruction-response pairs dataset. It is one of the most common datasets for fine-tuning models for instruction following. This dataset is public on Hugging Face. With LLaMA-Factory, you can specify the dataset's URI from a remote repository like Hugging Face directly in the YAML file to set up your training configuration, LLaMA-Factory will automatically download the dataset. To achieve this, you must define the dataset in a file named dataset_info.json, located in LLaMA-Factory/data/dataset_info.json. Add the following line to dataset_info.json. [code lang="js"] "uncensored_alpaca": {"hf_hub_url": "xzuyn/open-instruct-uncensored-alpaca"} [/code] When you have downloaded the dataset on the machine, you can add the following line to dataset_info.json and you are good to go. [code lang="js"]"your_dataset_name": {"file_name": "path/to/your/dataset.json"}[/code] 6.2. Model: LLaMA 3.1 8B The LLaMA 3.1 8B model is one of the latest releases in Meta’s third-generation LLaMA series. It is a lightweight yet powerful large language model designed for both research and enterprise applications. LLaMA 3.1 8B can be trained efficiently on multi-GPU multi-node Metal Cloud servers using LLaMA-Factory and DeepSpeed. The next sections of this guide will walk you through setting up distributed training for LLaMA 3.1 8B using LLaMA-Factory. If you want to download the model directly from Huggingface, you can use the below command: [code lang="js"] huggingface-cli download meta-llama/Llama-3.1-8B --local-dir=Llama-3.1-8B [/code] 7. Preparing training configuration LLaMA-Factory uses YAML configuration files to manage training parameters efficiently. A YAML-based configuration simplifies hyperparameter tuning and ensures reproducibility. This section explains how to prepare a YAML configuration file for fine-tuning the LLaMA 3.1 8B model using LLaMA-Factory. 7.1. Sample YAML Configuration for Fine-Tuning LLaMA 3.1 8B LLaMA-Factory provides various predefined YAML training configuration files, located at LLaMA-Factory/examples. Here is a YAML file for full fine-tuning LLaMA 3.1 8B with Open Instruct Uncensored Alpaca dataset: [code lang="js"] model_name_or_path: meta-llama/Llama-3.1-8B trust_remote_code: true stage: sft do_train: true finetuning_type: full deepspeed: examples/deepspeed/ds_z2_config.json dataset: uncensored_alpaca template: llama3 cutoff_len: 2048 max_samples: 500000 overwrite_cache: true preprocessing_num_workers: 16 output_dir: saves/llama3.1-8b/full/sft logging_steps: 10 save_steps: 10000 plot_loss: true overwrite_output_dir: true per_device_train_batch_size: 4 gradient_accumulation_steps: 2 learning_rate: 1.0e-5 num_train_epochs: 2.5 lr_scheduler_type: cosine warmup_ratio: 0.1 bf16: true ddp_timeout: 180000000 val_size: 0.001 per_device_eval_batch_size: 1 eval_strategy: steps eval_steps: 10000 [/code] You can put the model URI on Huggingface directly with: [code lang="js"] model_name_or_path: meta-llama/Llama-3.1-8B [/code] and LLaMA-Factory will automatically download the model before training. If you have downloaded the model on the machine, you can specify as: [code lang="js"] model_name_or_path: path/to/your/model [/code] To train on Open Instruct Uncensored Alpaca dataset, add the data by the specified name: [code lang="js"] dataset: uncensored_alpaca [/code] We adjust the number of training samples to 500,000 samples by: [code lang="js"] max_samples: 500000 [/code] You can adjust all other options if necessary 8. Configuring Slurm for Multi-Node Training Assume you have a YAML training configuration file named llama31_training.yaml, create a Slurm script train_llama.sbatch for training on 4 nodes, 8 GPUs per node: [code lang="js"] #!/bin/bash #SBATCH --job-name=multinode-training #SBATCH --nodes=4 #SBATCH --time=2-00:00:00 #SBATCH --gres=gpu:8 #SBATCH -o training.out #SBATCH -e training.err #SBATCH --ntasks=4 nodes=($(scontrol show hostnames $SLURM_JOB_NODELIST ) ) nodes_array=($nodes) head_node=${nodes_array[0]} node_id=${SLURM_NODEID} head_node_ip=$(srun --nodes=1 --ntasks=1 -w "$head_node" hostname --ip-address | cut -d" " -f2) echo Master Node IP: $head_node_ip export LOGLEVEL=INFO export NNODES=4 export NPROC_PER_NODE=8 export HEAD_NODE_IP=$head_node_ip export HEAD_NODE_PORT=29401 export NODE_RANK=$node_id export NCCL_IB_DISABLE=0 export NCCL_SOCKET_IFNAME=^lo,docker0 export NCCL_TIMEOUT=180000000 export NCCL_DEBUG=INFO export NCCL_BLOCKING_WAIT=1 # Ensure NCCL waits for operations to finish export NCCL_ASYNC_ERROR_HANDLING=1 # Allow handling of NCCL errors asynchronously source venv/bin/activate</em></wp-p> srun llamafactory-cli train llama31_training.yaml [/code] Use sbatch to submit the training job: sbatch train_llama.sbatch View the queue job with squeue Inspect the training.out and training.err file to see the training progress All 4 nodes are utilized perfectly. The final result is shown below: 9. Monitoring CPU and GPU Usage During Training When training large-scale models like LLaMA 3.1 8B on Metal Cloud, it is important to monitor system resources such as CPU, GPU, memory, and disk usage. Proper monitoring helps in: Detecting bottlenecks (e.g., underutilized GPUs, CPU overload). Optimizing resource allocation (e.g., adjusting batch sizes). Avoiding system crashes due to out-of-memory (OOM) errors. Bare Metal provides a monitoring page where users can track real-time hardware usage, including: GPU Utilization – See how much each GPU is being used. VRAM Usage – Check memory consumption per GPU. CPU Load – Monitor processor usage across nodes. Disk & Network Stats – Identify I/O bottlenecks. Users can access the monitoring page via their Metal Cloud dashboard to ensure efficient and stable training. Conclusion This guide provides a structured approach to setting up distributed training for LLaMA-Factory on Metal Cloud. We covered: Environment setup Slurm job submission Distributed training with LLaMA-Factory and DeepSpeed Optimizations for large-scale models Following these steps, you can fine-tune LLaMA models efficiently on Metal Cloud multi-node GPU clusters. Metal Cloud is now available on FPT AI Factory for reservation. Find out more at: https://aifactory.fptcloud.com/  For more information and consultancy, please contact: Hotline: 1900 638 399 Email: [email protected] Support: m.me/fptsmartcloud

Japan, November 13, 2024 — FPT, a global leading IT firm and Preferred NVIDIA Cloud Partner (NCP), officially announced the launch of the FPT AI Factory in Japan using the full-stack NVIDIA accelerated computing platform. This flagship solution serves as a one-stop shop for AI and Cloud services, offering immense computing power for AI advancement and contributing to developing Sovereign AI in the country. Japanese customers can expedite AI development with priority access to premium solutions and features through an exclusive pre-order.  The launching of FPT AI Factory in Japan by Mr. Le Hong Viet, CEO, FPT Smart Cloud, FPT Corporation At the NVIDIA AI Summit in Japan, FPT has debuted FPT AI Factory, an all-inclusive stack for end-to-end AI product lifecycle, including three main groups. FPT AI Infrastructure offers GPU cloud services with unprecedented computing power to accelerate model development and deployment. FPT AI Studio offers intelligent tools for building, pre-training, and fine-tuning AI models in depth using NVIDIA NeMo. FPT AI Inference, supported by NVIDIA NIM and NVIDIA AI Blueprints, enables customers to effectively deploy and scale their models in terms of size and number of usages. FPT AI Factory is integrated with 20+ ready-to-use AI products, built upon Generative AI, for rapid AI adoption and instant results in elevating customer experience, achieving operational excellence, transforming the human workforce, and optimizing operating expenses.    Powered by thousands of NVIDIA Hopper GPUs and next-generation ones, boosting with the latest NVIDIA AI Enterprise software platform, FPT AI Factory grants regional clientele scalable and confidential supercomputing along with essential tools to cultivate sophisticated AI technologies from scratch with faster time-to-market. This also empowers businesses to manage resources and processes expeditiously, optimizing total cost of ownership (TCO).   FPT is now accepting pre-orders for FPT AI Factory, allowing local corporate clients to leverage the diverse ecosystem of AI and Cloud, earn cloud credit, and gain early access to premium features. Combined with tailor-made consultation from seasoned AI & Cloud experts, enterprises in any industry can reinforce successful AI journeys with practical, high-value solutions.  Japan currently faces a shortage of GPU cloud solutions necessary to drive economic growth, promote innovation, and facilitate digital transformation in a secure manner. FPT’s AI-ready infrastructure in Japan provides local businesses and the government with unparalleled computational performance, high efficiency, and low-latency interactions to enrich research & development capabilities while safeguarding sensitive data and maintaining sovereignty.   By joining the NVIDIA Partner Network as a Service Delivery Partner, FPT will utilize NVIDIA's cutting-edge products and technologies to develop bespoke cloud services, hardware, software, and comprehensive integration services to drive the digital transformation in Japan.  Dr. Truong Gia Binh, FPT Corporation Chairman and Founder, shares FPT’s commitment to accompanying Japan in facilitating a successful AI journey Dr. Truong Gia Binh, FPT Corporation Chairman and Founder, affirmed, "Artificial intelligence continues to be a transformative technology for the entire world. In line with NVIDIA's global initiative, we are working closely with strategic partners to develop cloud infrastructure essential for AI applications worldwide, especially in Japan. We are committed to dedicating all necessary resources and accompanying the Japanese government, enterprises, and partners in the nation’s AI investment and development efforts. Through this significant project, we are aligning our vision and action to rapidly expand AI applications on a global scale while actualizing the collective vision of Japan and Vietnam in becoming AI nations.”  John Fanelli, NVIDIA Vice President of Enterprise AI Software, said, "In today's rapidly evolving technological landscape, Japan recognizes the importance of sovereign AI solutions for driving innovation, supporting data security, and maintaining technological independence. The FPT AI Factory built on NVIDIA accelerated computing and software represents a significant step towards meeting this need, offering Japanese companies access to cutting-edge AI infrastructure while fostering local AI development and expertise."  In April 2024, FPT publicized the development of AI Factories through a comprehensive strategic collaboration with NVIDIA. That marked a significant milestone in FPT's AI journey, aiming to promote AI research and development in the region and expand advanced AI and cloud capabilities on a global scale.        About FPT Corporation  FPT Corporation (FPT) is a global leading technology and IT services provider headquartered in Vietnam. FPT operates in three core sectors: Technology, Telecommunications, and Education. As AI is indeed a key focus, FPT has been integrating AI across its products and solutions to drive innovation and enhance user experiences within its Made by FPT ecosystem. FPT is actively working on expanding its capabilities in AI through investments in human resources, R&D, and partnerships with leading organizations like NVIDIA, Mila, AITOMATIC, and Landing AI. These efforts are aligned with FPT's ambitious goal to reach 5 billion USD in IT services revenue from global markets by 2030 and solidify its status among the world's top billion-dollar IT companies.  After nearly two decades in Japan, FPT has become one of the largest foreign-invested technology firms in the country by human resource capacity. The company delivers services and solutions to over 450 clients globally, with over 3,500 employees across 17 local offices and innovation hubs in Japan, and nearly 15,000 professionals supporting this market worldwide.   With Japan as a strategic focus for the company’s global growth, FPT has been actively expanding its business and engaging in M&A deals, such as the joint venture with Konica Minolta, strategic investment in LTS Inc, and most recently, the acquisition of NAC—its first M&A deal in the market. As digital transformation, particularly legacy system modernization viewed as a key growth driver in the Japanese market, the company is committed to providing end-to-end solutions and seamless services, utilizing advanced AI technologies as a primary accelerator. For more information, please visit https://fpt.com/en. 

The Terms of Use stipulate the terms that are binding you when using the services. The terms “You” and/or “User” hereinafter collectively refer to the users of the services. Please read carefully and save a copy of these Terms of Use. General Regulations By visiting the website https://fptcloud.com/ and using the services, You agree to be bound by these terms of use, our Advertising Policy and Privacy Policy. (See main Privacy Policy here) We operate these Terms of Use, the Advertising Policy and the Privacy Policy in accordance with applicable law, and nothing contained in the above documents is in derogation of our right to comply with such regulations or requirements. government, court, or enforcement agency requests related to Your use of the services or information received by us or obtained from Your use of the services. Deny-guarantee FPT Cloud website and services are provided on a non-warranty basis, on a service and feature availability basis and We do not guarantee that the website features or services will meet Your requirements or guarantee that the operation of the software or services will be uninterrupted or error free. We are not responsible for any loss of data, loss of benefits or other issues related to accessing the FPT Cloud website and using the services, including but not limited to all information, data, text, software, music, sound, images, graphics, video, messages or other materials (“Content”) that You may store, upload , or transmitted through the service. You agree to use the services at your sole risk. Changes in Terms of Use We reserve the right to change and/or modify without prior notice any provision of these Terms of Use from time to time. Changes and/or modifications will take effect immediately upon posting to the FPT Cloud website. If You continue to access or use the services after changes and/or modifications are posted, You accept and agree to such changes and/or modifications. Usage Regulations When using our services, besides having to sign a service contract, You are also bound to accept and comply with the conditions set forth below: Pay service fees as agreed Comply with legal regulations If any disputes arise, both sides agree to resolve them on the basis of cooperation and agreement. Rules of Use We provide services to You completely through the online system of the FPT Cloud website from the moment You register an account, choose the service as well as pay the service fee when you use Our service. You confirm and agree that You have carefully researched and will fully comply with the regulations on account registration, fee calculation and payment methods posted on our FPT Cloud Website ("Regulations on Registration and Service Use"). By confirming that you have completed the account registration procedure on the FPT Cloud website, you have agreed to be bound by regulations on service registration when you use the services. We always change and/or amend the content of these Terms of Use as well as the Regulations on Registration and Service Use with the goal of best completing the regulations and meeting maximum convenience and efficiency when You use the services, as well as ensuring the enhancement of Our benefits when providing the services. We reserve the right to change and/or modify without prior notice any changes and/or modifications to the Terms of registering and service use. Changes and/or modifications will take effect immediately upon posting to the FPT Cloud website. If You continue to use the services after changes and/or modifications are posted, You accept and agree to such changes and/or modifications. We recommend that you should regularly check the FPT Cloud website and contact our support staff to get the latest updates to the Regulations on Registration and Service Use. Limitation of Liability You acknowledge and agree that we are only available to provide the services if You agree to limit our liability to You and third parties. You agree that You are solely and entirely responsible for indemnifying any claim or action against us relating to any violation of the terms of use resulting from Your use of the services or stop using our services. You agree to be solely responsible for the content and information provided to us You agree to defend, indemnify and hold us and our affiliated companies and each of their respective officers, directors, employees, agents, representatives, information providers and licensors harmless from any claims, suits, costs, losses, damages, court judgments and expenses, including but not limited to attorney's fees, damages, litigation costs, late payment interest related to or arising from any complaints, conflicts, disputes, legal proceedings in Court or Arbitration organizations, Conciliation organizations, decisions of competent State agencies... related to or arising from products and services. We reserve the right, at Our own expense, to assume the exclusive defense and control of (but have no liability) any matter so arising subject to indemnification by You. Copy protection and Intellectual property Services and all necessary software, components of the services and the exploitation and implementation of the Services, and including intellectual property rights in respect of our services and products , and all necessary software, components of the Services (“Intellectual Property”), are protected by copyrights, trademark rights, service marks, or other proprietary rights owned by us or is owned by any third party that has granted intellectual property rights to us. You are not entitled to use any of our trade names, trademarks of goods and services, logos, domain names and other distinctive forms of identification of our goods and services for commercial purposes except when You have our written consent, or your use affects, hinders, or adversely affects the normal operation of our products and services and our reputation. We respect the intellectual property rights of others and require that users of our services do the same. You may not upload, embed, post, transmit or otherwise make available any material that infringes any intellectual property rights of copyright, trademark, trade secret or other property rights of any organization or individual. We reserve the right to terminate access to the services or any other service provided by us to suspected infringers. Other Terms Adjustment These Terms of use are adjust by and construed in accordance with the laws of Vietnam. If any provision of these Terms of Use shall be unlawful, invalid, or for any reason unenforceable, then that provision shall be deemed severable from these Terms of Use and shall not affect affect the validity and enforceability of any remaining provisions of these Terms of Use. End of Term These Terms of Use are effective until terminated by You or by us under the following circumstances: Termination by You: You may terminate these terms of use by no longer using the services. Termination by Us: These Terms of Use terminate immediately without prior notice from us. Contact If you have any questions about these terms of use, the operation of the services, or your connection with us, please contact us via Hotline. All problems or conflicts will be resolved quickly and reasonably.

I. General Policies and Regulations FPT Cloud is owned by FPT Smart Cloud – a leading enterprise providing Artificial Intelligence (AI) & Cloud Computing (Cloud) solutions through a consolidated technology platform, diverse product ecosystem, and global connectivity. The website https://fptcloud.com/ is a property of FPT Smart Cloud with a mission to provide detailed information regarding Cloud-based products and solutions for businesses, helping them to deploy digital transformation solutions, save capital costs, and enhance operational efficiency. Upon your visit to our website, you have agreed to the terms stated on the website. The website has the right to adjust, modify, add or delete any terms within the Terms & Conditions section at any time, and the changes will apply immediately when updated on the website without prior notice. Please check frequently for our updates. 1. Agreement on Conditions of Use 2. Features of Information Display All information displayed on the website https://fptcloud.com/ is to clarify FPT Smart Cloud product and service information. Other related information to provide knowledge for customers will clearly cite sources. II. Conditions of Payment Method Customers can make online payments using Visa, MasterCard, or debit cards. You can transfer to the following account: Account Name: Cong ty TNHH FPT Smart Cloud Account Number: 20138138901 Bank: TPBank III. Terms of Service Installation Customers can create an account at the “Register” section to purchase services on https://fptcloud.com/. Contact hotline or email: [email protected] for support. IV. Services use procedures New users create an account on https://fptcloud.com/, then sign-in. Next, select “Create Project” to name the new project and then select the desired service. From here, customers can try FPT Cloud services or proceed to purchase. V. Return/Refund policy As a customer registers for the service, there will be no available option for cancellation, change, or refund under any circumstances VI. Warranty/Maintenance Policy Our services are online, thus, we do not offer this policy. We guarantee conformance to the Quality Commitment Form signed with customers regarding technical support, complaint, compensation, etc.

This security policy is intended to ensure information security related to organizations and individuals participating in accessing and/or transacting on the website https://fptcloud.com/. Purpose of gathering information The privacy policy describes how FPT Cloud receives, synthesizes, stores, uses and protects information of organizations and individuals participating in accessing and transacting on FPT Cloud (customers). Customers accessing or transacting on FPT Cloud is understood to mean that the customer has read, understood and agreed to comply with this policy, including amended and supplemented versions of the policy. The amended and supplemented version of this policy (if any) will take effect 5 days from the date the policy amendment and supplement is notified on FPT Cloud. Specific policies Scope of information collection When customers make transactions and/or register accounts at FPT Cloud, from time to time, customers must provide some necessary information for making transactions and/or registering accounts. Customers are responsible for ensuring that the information they provide is complete and accurate and always updates the information to ensure completeness and accuracy. FPT Cloud is not responsible for resolving any disputes if the information provided by customers is inaccurate, not updated or fake. Customers agree to allow FPT Cloud to record and retain the content of (i) customer calls to FPT Cloud's customer care hotline; and (ii) calls from FPT Cloud's customer care department to customers (hereinafter collectively referred to as Recordings). Our privacy commitment All customer information, as well as information exchanged between customers and FPT Cloud, are stored and secured by FPT Cloud's system. FPT Cloud has technical and security measures to prevent unauthorized access and use of customer information. FPT Cloud also regularly coordinates with security experts to update the latest information on network security to ensure the safety of customer information when customers access, register to open an account and/or Use FPT Cloud features. When collecting data, FPT Cloud stores and secures customer information on the server system and this customer information is secured by firewall systems and data encryption. Customers are absolutely not allowed to use any tools or programs to illegally interfere with the system or change the data structure of FPT Cloud, as well as any other actions to spread, promoting activities with the purpose of interfering, sabotaging or infiltrating data of the FPT Cloud system, as well as acts prohibited by Vietnamese law. In case FPT Cloud detects that a customer has intentionally forged, committed fraud, illegally distributed information, etc. FPT Cloud has the right to transfer the customer's personal information to the competent authorities for processing. according to the provisions of law. How long do we keep customer's information For current accounts, FPT Cloud will store and use unlimited customer information until the customer closes the account. For closed accounts, FPT Cloud still stores personal and access information of customers to serve the purposes of fraud prevention, investigation, answering questions... This Personal information will stored by FPT Cloud on the server system for a maximum of 12 (twelve) months from the date the customer closes the account. After this period ends, FPT Cloud will permanently delete the customer's Personal information. Scope of using customer's information FPT Cloud has the right to use the information provided by customers, including but not limited to customer information to: Provide services/utilities for customers based on customers' needs and habits when accessing FPT Cloud; Detect and prevent fraudulent activities, sabotage of customer accounts or activities of falsifying customer identities on FPT Cloud; Contact, support communication and resolve with customers in special cases. Links to other websites Customers are responsible for protecting their account information, do not provide any information related to their account and password on FPT Cloud on other websites except when logging in to the main address. FPT Cloud official website at www.fptcloud.com Customers must be solely responsible for problems that arise when they access FPT Cloud from websites other than FPT Cloud's official website. Sharing customer information FPT Cloud does not provide customer information to any third party unless at the request of competent state agencies, or according to the provisions of law, or when providing that information is necessary for FPT Cloud to provide services/utilities to customers (for example, providing necessary information for software deployment or demo units...). In addition to the above cases, FPT Cloud will provide specific notice to customers when it must disclose customer information to a third party. In this case, FPT Cloud commits to only disclose customer information with the customer's consent. FPT Cloud can share customer information for the following purposes: Market research and analytical reports: FPT Cloud can use customer information to research the market, synthesize and analyze general customer information (for example: average age, geographical area), detailed information will be hidden and used only for statistical purposes. In the event that FPT Cloud conducts a survey requiring customer participation, any responses to the survey or poll that the customer provides to FPT Cloud will not be transferred to any third party. Exchange customer information with partners that have signed a customer care agreement with FPT Cloud: FPT Cloud can share customer information with affiliated partners and FPT Cloud's domestic and international websites. This sharing helps FPT Cloud provide customers with information about products and services, related to goods, services and other issues that customers may be interested in. In case FPT Cloud's affiliated companies are granted access to customer information, they will have to strictly comply with the regulations described in this policy. Exchange of customer information with third parties who are FPT Cloud's partners: FPT Cloud can transfer customer information to agents and subcontractors for data analysis, marketing and customer service support. FPT Cloud can also exchange customer information with third parties for fraud prevention and credit risk management. Exchange customer information with advertising partners: The customer behavior tracking system is used by FPT Cloud on advertising display channels (customer marketing, reporting on demographics, interests, customer preferences with Google Analytics tool...) can collect information such as age, gender, interests and number of interactions with the number of ad appearances. With the ad settings feature, customers can choose to exit the Google Analytics customer behavior tracking feature and choose how the advertising display channel appears on Google. Customer benefits Customers have the right to request access to their personal data, and have the right to request FPT Cloud to correct errors in customer data without charge. Customers have the right to request FPT Cloud to stop using customers' personal data for marketing purposes at any time. Cookie policy FPT Cloud provides cookies or similar technologies to collect information such as: access history, customer choices when accessing and using features of FPT Cloud... to increase the experience security and helps FPT Cloud understand customers' needs and preferences so they can provide better services. Contact If you have any questions, concerns, or comments about our privacy policy, please contact us via the contact form on the website or directly via the hotline. We reserve the right to make changes in this policy. All changes will be reflected on the website.

FPT Smart Cloud Company Limited (“FPT Smart Cloud”) develops this Personal Data Protection Policy (“Policy”) so that Customers can better understand the purpose and scope of information that we process, the measures we take to protect your personal information and your rights with respect to these activities. This policy is an inseparable part of the Contract, Terms of Use, Policies and other usage agreements of FPT Smart Cloud, published on FPT Smart Cloud's transaction channel from time to time.   Article 1. Definition 1.1. FPT Smart Cloud: is FPT Smart Cloud Company Limited, tax code 0109307938. Head office at No. 10 Pham Van Bach, Dich Vong Ward, Cau Giay District, Hanoi City, Vietnam. 1.2. Customer: is an individual customer, with information provided to FPT Smart Cloud when registering and using FPT Smart Cloud's Services. 1.3. Personal data: is information in the form of symbols, letters, numbers, images, sounds or similar forms in the electronic environment that are associated with a specific person or help identify a specific person. Personal data includes basic personal data and sensitive personal data. 1.4. Basic personal data includes: (a) Surname, middle name, birth name, other names (if any); (b) Date, month and year of birth; date, month, year of death or disappearance; (c) Gender; (d) Place of birth, place of birth registration, permanent residence, temporary residence, current residence, hometown, contact address; (e) Nationality; (f) Images of individuals; (g) Phone number, ID card number, personal identification number, passport number, driver's license number, license plate number, personal tax code number, social insurance number, insurance card number medical insurance; (h) Marital status; (i) Information about family relationships (parents, children); (j) Information about individuals' digital accounts; Personal data reflecting activities and history of activities in cyberspace; (k) Other information that pertains to a specific person or identifies a specific person does not fall within Sensitive Personal Data. (l) Other data according to current legal regulations. 1.5. Sensitive personal data is personal data associated with an individual's privacy rights , if violated will directly affect the individual's legitimate rights and interests, including: (a) Political views, religious views; (b) Health status and personal life recorded in medical records, excluding information on blood type; (c) Information related to racial and ethnic origin; (d) Information about inherited or acquired genetic characteristics of the individual; (e) Information about the individual's physical attributes and biological characteristics; (f) Information about the individual's sex life and sexual orientation; (g) Data on crimes and criminal acts collected and stored by law enforcement agencies; (h) Customer information of credit institutions, foreign bank branches, payment intermediary service providers, and other authorized organizations, including: customer identification information according to regulations of law, account information, deposit information, deposited asset information, transaction information, information about organizations and individuals who are guarantors at credit institutions and bank branches, an organization providing intermediary payment services; (i) Data about the individual's location determined through location services; (j) Other personal data specified by law are special and require necessary security measures 1.6. Personal data protection: is the activity of preventing, detecting, stopping, and handling violations related to personal data according to the provisions of law. 1.7. Personal data processing: is one or more activities affecting personal data, such as: collecting, recording, analyzing, confirming, storing, editing, disclosing, combining, accessing, export, retrieve, encrypt, decrypt, copy, share, transmit, provide, transfer, delete, destroy personal data or other related actions. 1.8. FPT Smart Cloud transaction channel: includes FPT Smart Cloud electronic transaction Channel (Hotline, Facebook, registration form on Website...) or other transaction channels from time to time provided by FPT Smart Cloud to Customers. Article 2. Types of data processing 2.1. FPT Smart Cloud processes the following types of Personal Data of Customers: (a) Surname, middle name, birth name, other names (if any); (b) Telephone number (k) Email 2.2. Processed personal data includes data customers provide to FPT Smart Cloud when registering to use the service and data arising during the process of customers using FPT Smart Cloud services. Article 3. Data security principles of FPT Smart Cloud 3.1. Customers' personal data is committed to maximum security according to FPT Smart Cloud regulations and law. The processing of each Customer's Personal Data is only carried out with the Customer's consent, unless otherwise provided by law. 3.2. FPT Smart Cloud does not use, transfer, provide or share with any third party Customer's personal data without the Customer's consent, unless otherwise prescribed by law. 3.3. Other principles according to current legal regulations. Article 4. Processing purposes 4.1. Customer agrees to allow FPT Smart Cloud to process Customer's personal data and share data processing results for the following purposes: a) Support Customers, update Customer information when purchasing and using products and services provided by FPT Smart Cloud or FPT Smart Cloud partners. b) Providing products and services of FPT Smart Cloud, products and services of FPT Smart Cloud in cooperation with partners for Customers. c) Organize trade introduction and promotion, market research, public opinion polls, and brokerage. d) Research, develop new services and provide suitable products and services to Customers. e) Providing marketing services and introducing advertising products. f) Measure, analyze floating data, evaluate and do other processing to improve and enhance the quality of services that FPT Smart Cloud provides to customers. g) Investigate and resolve customers' questions and complaints. h) Adjust, update, secure and improve products, services and devices that FPT Smart Cloud is providing. i) Verify identity and ensure confidentiality of Customer information. j) Notify Customers about changes to policies and promotions of products and services that FPT Smart Cloud is providing. k) Prevent and prevent fraud, identity theft and other illegal activities. l) Comply with applicable laws, relevant industry standards and other applicable policies of FPT Smart Cloud. m) Any other purpose specific to the operation of FPT Smart Cloud and any other purpose that FPT Smart Cloud notifies the Customer, at the time of collecting the Customer's personal data or before commencing relevant processing or as otherwise required or permitted by applicable law. 4.2. In case it is necessary to process Customer's Personal Data for other purposes or at Customer's request, FPT Smart Cloud will notify Customer through FPT Smart Cloud's transaction channels so that Customer can express their agree before implementation. Article 5. Organization to Process Personal Data 5.1. FPT Smart Cloud Company Limited, tax code 0109307938. Head office at No. 10 Pham Van Bach, Dich Vong Ward, Cau Giay District, Hanoi City, Vietnam. 5.2. FPT Smart Cloud will share or jointly process personal data with the following organizations and individuals: a) FPT Group and member companies under FPT Group. b) Member companies that FPT Smart Cloud directly or indirectly owns. c) Contractors, agents, partners, and operational service providers of FPT Smart Cloud. d) Branches, business units and employees working at branches, business units and agents of FPT Smart Cloud. e) Telecommunications businesses in case the Customer violates the obligation to pay service fees. f) Commercial stores and retailers related to the implementation of FPT Smart Cloud promotional programs. g) FPT Smart Cloud's professional advisors such as auditors and lawyers according to the provisions of law. h) Courts and competent state agencies in accordance with the provisions of law and/or when required and permitted by law. FPT Smart Cloud commits to sharing or jointly processing personal data only in cases where it is necessary to effectuate the Processing Purposes stated in Article 4 of this Policy or as prescribed by law. Organizations and individuals that receive Customer's personal data will have to comply with the provisions of this Policy and relevant legal regulations on personal data protection. Although FPT Smart Cloud will make every effort to ensure that Customer information is anonymized/encrypted, the risk that this data may be disclosed in some force majeure cases. 5.3. In case of participation of other personal data processing organizations mentioned in this Article, Customer agrees that FPT Smart Cloud will notify Customer through FPT Smart Cloud's transaction channels before FPT Smart Cloud effectuate. Article 6. Processing of Personal Data in some special cases FPT Smart Cloud ensures that the processing of Customer's personal data fully meets the requirements of the law in the following special cases: 6.1. Surveillance camera (CCTV) footage, in specific cases, may also be used for the following purposes: a) For quality assurance purposes; b) For public security and labor safety purposes; c) Detect and prevent suspicious, inappropriate or unauthorized use of FPT Smart Cloud utilities, products, services and/or facilities; d) Detect and prevent criminal acts; and/or e) Conduct investigation of incidents. 6.2. FPT Smart Cloud always respects and protects children's personal data. In addition to personal data protection measures prescribed by law, before processing children's personal data, FPT Smart Cloud will verify the age of the child and request consent from: a) Children and/or b) Father, mother or guardian of the child as prescribed by law. 6.3. In addition to complying with other relevant legal regulations, for the processing of personal data related to personal data of people declared missing/deceased, FPT Smart Cloud will have to obtain consent of one of the relevant persons according to the provisions of current law. Article 7. Storing Personal data FPT Smart Cloud commits to only storing Customer's personal data in cases related to the purposes stated in this Policy. FPT Smart Cloud may also need to store your personal data for a period of time when required by applicable law. Article 8. Customer Rights 8.1. Customers have the right to know about the processing of their personal data, unless otherwise provided by law. 8.2. Customers can agree or disagree to the processing of their personal data, unless otherwise provided by law. 8.3. Customers have the right to access, view, edit or request correction of their Personal Data in writing to FPT Smart Cloud, unless otherwise prescribed by law. 8.4. Customers have the right to withdraw their consent in writing sent to FPT Smart Cloud, unless otherwise prescribed by law. Withdrawing consent does not affect the legality of the data processing. Customer agrees with FPT Smart Cloud before withdrawing consent. 8.5. Customers have the right to delete or request deletion of their personal data in writing sent to FPT Smart Cloud, unless otherwise prescribed by law. 8.6 Customers have the right to request restriction of processing of their personal data in writing to FPT Smart Cloud, unless otherwise prescribed by law. Restriction of data processing will be implemented by FPT Smart Cloud within 72 hours after the Customer's request, with all Personal Data that the Customer requests to be restricted, unless otherwise prescribed by law. 8.7. Customers have the right to request FPT Smart Cloud to provide themselves with their personal data in writing sent to FPT Smart Cloud, unless otherwise prescribed by law. 8.8. Customers have the right to object to FPT Smart Cloud, the Organization processing personal data specified in Article 5 of this Policy processing their personal data in writing sent to FPT Smart Cloud in order to prevent or limit data disclosure Person or use for advertising and marketing purposes, unless otherwise provided by law. FPT Smart Cloud will fulfill the Customer's request within 72 hours after receiving the request, unless otherwise prescribed by law. 8.9. Customers have the right to complain, denounce or sue according to the provisions of law. 8.10. Customers have the right to claim compensation for actual damages according to the provisions of law if FPT Smart Cloud violates regulations on protecting their Personal data, unless otherwise agreed by both sides or otherwise provided by law. 8.11. Customers have the right to protect themselves according to the provisions of the Civil Code and other relevant laws, or request competent agencies and organizations to implement methods to protect civil rights as prescribed in Article 11 of the Civil Code. 8.12. Other rights as prescribed by current law. 8.13. Method of exercising rights: in writing sent to FPT Smart Cloud or calling hotline 1900 638 399 or send an email to [email protected] for instructions. Article 9. Customer's Obligations 9.1. Comply with laws, regulations, and instructions of FPT Smart Cloud related to processing Customer Personal Data. 9.2. Provide complete, honest and accurate Personal data and other information as requested by FPT Smart Cloud when registering and using FPT Smart Cloud services and when there are changes to this information. FPT Smart Cloud will secure the Customer's Personal data based on the information the Customer has registered, if there is any incorrect information, FPT Smart Cloud will not be responsible for cases that affects or limits the Customer's rights. In case of failure to notify, if any risks or losses arise, the Customer is responsible for errors or acts of exploitation or fraud when using the service due to customer's own fault or failure to provide correct, sufficient, accurate, and timely information changes; including financial losses and costs arising from incorrect or inconsistent information provided. 9.3. Coordinate with FPT Smart Cloud, competent state agencies or third parties in case of issues affecting the security of Customer's personal data. 9.4. Protect your personal data; proactively apply measures to protect your personal data while using FPT Smart Cloud services; promptly notify FPT Smart Cloud when detecting any errors or mistakes about your personal data or suspecting that your personal data is being violated. 9.5. Take responsibility for the information, data, and consent that you create and provide in the network environment; Take responsibility in case personal data is leaked or violated due to your own fault. 9.6. Regularly update the Regulations and Personal Data Protection Policy of FPT Smart Cloud from time to time as notified to Customers or posted on FPT Smart Cloud's Transaction Channel. Take actions according to FPT Smart Cloud's instructions to clearly indicate consent or disapproval for the purposes of processing Personal Data that FPT Smart Cloud notifies customers from time to time. 9.7. Respect and protect other people's personal data. 9.8. Participate in propagating and disseminating personal data protection skills. 9.9. Other responsibilities as prescribed by law. Article 10. Rights of FPT Smart Cloud 10.1. Process Customer's personal data according to the purpose, scope and other contents agreed with the Customer and/or agreed by the Customer. 10.2. Allow to amend, supplement content or replace this Policy from time to time and ensure that Customers are notified through FPT Smart Cloud's transaction channels before applying. If the Customer continues to use products and services, perform and conclude transactions with FPT Smart Cloud after FPT Smart Cloud notifies, it is understood that the Customer accepts all modifications, additions, and changes of this Policy by FPT Smart Cloud. 10.3. Has the right to refuse requests that are not legal by the Customer or that cannot be met due to infrastructure, technical or technological reasons. 10.4. Decide to apply appropriate measures to protect Customer Personal Data. 10.5. Be exempted from all obligations and responsibilities for risks that may occur during the processing of personal data, including but not limited to data loss due to system errors or external objective causes beyond the control of FPT Smart Cloud. 10.6. Other rights are specified in this Policy and according to the provisions of law. Article 11. Obligations of FPT Smart Cloud 11.1. Comply with legal regulations in the process of processing Customer's personal data. 11.2. Apply suitable information security measures to avoid unauthorized access, change, use, and disclosure of Customer's personal data. 11.3. Comply with Customer's lawful requests regarding Customer Personal Data. 11.4. Make sure to have a mechanism that allows Customers to exercise their rights related to their Personal Data. 11.5. Coordinate with competent state agencies and other relevant organizations, individuals to minimize damage when detecting legal violations against Customer Personal Data. 11.6. Other obligations are specified in this Policy and according to the provisions of law. Article 12. Data processing methods FPT Smart Cloud applies one or more activities affecting personal data such as: collection, recording, analysis, confirmation, storage, editing, disclosure, combination, access, retrieval, recall , encrypt, decrypt, copy, share, transmit, provide, transfer, delete, destroy personal data or other related actions. Article 13. Unwanted consequences, damage that may occur 13.1. FPT Smart Cloud uses many different security technologies to protect Customer's personal data from being retrieved, used or shared unintentionally. However, no data can be 100% confidential secure. Therefore, FPT Smart Cloud commits to maximum security of Customer's personal data. Some unwanted consequences and damages that may occur include but are not limited to: (a) Hardware and software errors during data processing cause loss of Customer data; (b) Security holes are beyond the control of FPT Smart Cloud, the system is attacked by hackers, causing data to be leaked; (c) Customers self-disclose personal data due to: carelessness or fraud; visit websites/download applications containing malware... 13.2. FPT Smart Cloud recommends that Customers keep confidential information related to the login password to their account, OTP code and not share this login password, OTP code with anyone else. 13.3. Customers should preserve electronic devices during use. Customers should lock, log out, or exit their accounts on website or FPT Smart Cloud's Application when no longer need to use them. 13.4. In case the data storage server is attacked by hackers leading to loss of Customer's personal data, FPT Smart Cloud will be responsible for reporting the incident to the investigating authorities for timely handling and notify customers. Article 14. Cookies 14.1. When Customers use or access FPT Smart Cloud's websites, FPT Smart Cloud may place one or more cookies on the Customer's device. “Cookie” is a small file placed on the Customer's device when the Customer visits a website. It records information about the Customer's device, browser, and in some cases, preferences and interests, Customers' news browsing habits. FPT Smart Cloud can use this information to identify Customers when they return to FPT Smart Cloud's websites, to provide personalized services on FPT Smart Cloud's websites, to compile analytical data to better understand website operations and to improve FPT Smart Cloud's websites. Customers can use their browser settings to delete or block cookies on their devices. However, if the Customer decides not to accept or block cookies from FPT Smart Cloud's websites, the Customer may not be able to experience full advantage of all the features of FPT Smart Cloud's websites. 14.2. FPT Smart Cloud may process Customer's personal information through cookie technology, according to the provisions of these Terms. FPT Smart Cloud may also use remarketing to serve ads to individuals that FPT Smart Cloud knows have previously visited its website. 14.3. To the extent third parties have placed content on FPT Smart Cloud's websites (e.g. social media features), those third parties may collect personal information from Customers. (e.g. cookie data) if Customer chooses to interact with such third party content or use third party services. Article 15. General provisions 15.1. This policy takes effect from July 1, 2023. Customers understand and agree that this Policy may be amended from time to time and will be notified to Customers through FPT Smart Cloud's transaction channels before application. Changes and effective date will be updated and announced in transaction channels and other channels of FPT Smart Cloud. The Customer's continued use of the service after the notice period of amendments and supplements from time to time means that the Customer has accepted those amendments and supplements. 15.2. Customers know and agree that this Policy is also the Notice of Personal Data Processing specified in Article 13 of Decree 13/ND-CP/2023 and amended and supplemented from time to time before FPT Smart Cloud conducts Personal Data Processing. Accordingly, FPT Smart Cloud does not need to take any additional measures for the purpose of notifying Customers of personal data processing. 15.3. Customers commit to strictly comply with the provisions of this Policy. For issues that have not been regulated, both sides agree to comply with the provisions of law, instructions of competent State agencies and/or amendments and supplements to this Policy will be FPT Smart Cloud notity to customers in each period. 15.4. This policy is agreed upon on the basis of goodwill between FPT Smart Cloud and the Customer. During the implementation process, if any disputes arise, the Parties will proactively resolve them through negotiation and conciliation. In case conciliation fails, the dispute will be brought to the competent People's Court for resolution according to the provisions of law. 15.5. The customer has carefully read, understood the rights and obligations and agreed to the entire content of this Personal Data Protection Policy. Information about the person responsible for FCI's Personal Data Protection: Person responsible: Pham The Minh Mobile: +84 913571357 E-mail: [email protected]

Numerous reports from research institutions such as Gartner, Forrester, Bain, and Deloitte have predicted trending technology innovations for 2021. This article will introduce the top 10 trending technologies in those reports.  10 - Zero trust Security is one of the core focuses for businesses, and the zero-trust approach (no default security option) will get more prominent in the next few years. Gartner predicts that the calculation and security platforms can be categorized to 3 domains: Platform providing a safe environment to process or analyze personal and sensitive identification data  Platform allowing non-focused data process and analysis  Platform offering encryptions and algorithms prior to data processing or analysis (i.e.: synchronous encryption) 9 - Digital office and remote working Gartner points out that “working everywhere” is a crucial trend, especially under COVID-19-alike circumstances. Technologies within these domains will get more popular: Collaboration and productivity increase Secure remote access Edge computing Digital experience quantifiers Forrester foresees a business shift to local operations, in which technology will allow organizations to expand to new geographical areas.  8 - Human-centric digital experience The UI/UX and human-centered design technologies will be a core domain. Virtual Reality and Augmented Virtual Reality will be used more and more to enhance the experience.  The multi-experience development platform and low-code development platform will continue to grow, helping to build interactive applications and products as parts of the digital experience with multiple touchpoints for users (i.e.: touch, voice, and gestures).  7 - Super automation Super automation is the application of advanced technology (i.e.: AI, machine learning) to optimize human resources and automate processes, generating more impacts than the traditional automation approach.  Procedure and IT automation using AI, machine learning, event-driven architecture, and robotic process automation will remain an important movement. Prominent platforms: UIPath, Blue Prism,...  6 - Internet of Behaviors (IoB) The Internet of Behaviors (IoB) was introduced by Gote Nyman in 2012. IoB itself possesses social and moral influences that must be clearly understood.  The technology uses digital data obtained from the Internet of Things (IoT) devices to change human behaviors. For example, satellite data for driving behaviors, social media data to analyze trends, authentication data for security, and more. 5 - Intelligent business processes and platforms from the provider The agile organizational process to adapt correspondingly to the market or environment conditions. The Covid-19 pandemic has provoked a surge in this trend to enable existing technology and strategic support processes flexibly.  This includes faster decision-making, better supportive tech platforms, and more flexible providers to create possible business capabilities. 4 - 5G 5G promises to reduce delays by 100 times and provide information to construct new solutions.  Higher bandwidth for data sharing, higher transmission speed, and lower delays will certainly enhance the customer experience when connecting devices.  3 - Cybersecurity With increasingly remote activities, cybersecurity is a must for business. Gartner determines that cybersecurity will be a core technology in 2021. The security discovery will continue to be a significant movement to protect human identity and devices. 2 - Distributed Cloud Public Cloud vendors acknowledge the importance of supporting on-demand computing and edge computing. Yet, the continuous demand has tremendously stimulated distributed cloud computing. According to Gartner, the distributed cloud distributes public cloud services to different real locations while the initial public cloud provider is responsible for service operations, administrations, and updates.  1 - AI Technology AI technology is on top of the list because of its ability to enhance business continuity values. Organizations will optimize the advantages of AI through AI-powered operations using DataOps, ModelOps (MLOps), and DevOps. The use of AI on the Edge platform will increase, allowing AI algorithms to work on the edge of the network (closer to information gathering devices). Dominant platforms: Databricks, Snowflake, Azure Machine Learning, Amazon Sagemaker... The journey will continue and these top-notch technologies will further improve in 2021 and more. ———————————————————————— FPT Smart Cloud is committed to providing best-in-class products and services at the optimal expense for customers. Contact us now for support: Email: [email protected] Hotline: 1900 63 83 99