To provide stable service under high concurrent, workloads is always a challenge network application systems faced. Load balancing mechanic can redistribute server workloads among server cluster to meet the request and realize high scalability and high availability. This article introduces the theory and method to build a software-based load balancing architecture by use LVS, and demonstrates the configuration and application of LVS via a real case. Actual operating results show that the architecture can well satisfy high concurrent workloads.