Cloud Computing and Chargeback Models
By
Mitesh Soni
Chargeback and metering refers to the ability of an IT organization to track and measure the IT expenses per business unit and charge them back accordingly. According to Role, chargeback includes different dimensions.
The idea of chargeback in the IT industry was developed in the mainframe era. Mainframes were very expensive, and buying a mainframe for small- to medium-sized business was a problem. So the businesses that had these mainframes began providing the computing services to the small businesses to cope with the operational costs and to better utilize the resources of these expensive mainframes.
The idea of chargeback in the IT industry was developed in the mainframe era. Mainframes were very expensive, and buying a mainframe for small- to medium-sized business was a problem. So the businesses that had these mainframes began providing the computing services to the small businesses to cope with the operational costs and to better utilize the resources of these expensive mainframes
The central idea is that computing resources and services are metered like electricity, so customers pay only for what they use. Internally, enterprises can charge back business units or at least use “showback” to educate managers about the costs of computing and strategic expenditures.
|
| Figure 2: IT department provides services to external departments as service providers. |
Traditionally, organizations funded server (and storage) acquisition as part of the new project process. But virtualization breaks this model; it is a method of making a physical entity act as multiple, independent logical entities (virtual machines). Thus chargeback needs to consider this dimension due to use of shared resources in virtualization.
In designing an accounting mechanism to support new technologies, two factors must be determined: 1) the resource metrics on which chargeback will be based, 2) How to account for the excess capacity required for supporting a dynamic, shared-usage model.
|
| Figure 3: IT Production and Customers are consolidating servers that runs IT applications but still customized application on dedicated servers exists. |
As newer technologies like de-duplication become more widely adopted, issues like whether to charge by logical (virtual) gigabyte or physical de-duplicated gigabyte and how to predict or plan for that. Accurate chargeback are instrumental in showing business units the direct benefits of virtualization.
Overview of the Chargeback Model
An IT chargeback system is a method of accounting for technology-related expenses that applies the costs of services, hardware and software to the business unit in which they are used. IT chargeback systems are sometimes called “responsibility accounting” because this sort of accounting demonstrates which departments or individuals are responsible for significant expenses.
Reporting systems that leverage IT chargeback provide end users with more transparency into which business decisions are creating expenses and help management identify how to achieve greater efficiency.
In the traditional chargeback model, an IT department might divide its budget for services by the total number of business units it serves. In the cloud, that scenario gets even more complex because IT needs to consider the rate and time of consumption.
Chargeback Goals:
- Provide Business Units with Information
- Identify Services Required
- Control or Influence Costs
- Use Resources More Effectively
- Improve Productivity
Architecture and Implementation Technology Stack
A few key steps can help you implement this model and resolve some chargeback chores:
Implementation
- Evaluate the needs of the business
- Anticipate how the business units would benefit from a chargeback system
- Determine whether business units are just seeking more control over IT processes, whether divisions are trying to determine if projects are viable
- Anticipate cost to implement a chargeback model and business’ willingness to pay for it
- Evaluate software that will help with a chargeback program and help you implement the process.
Cost
- Materials and external costs—all the out-of-pocket costs associated with the project
- Creative and production, fully burdened labor
- Account management/project management/traffic, fully burdened labor
- Department management and administration
- Hardware and software costs
- Overhead (e.g., space and associated facility costs)
- Training and team events
Challenges
“Virtualization throws a very large wrench into IT chargeback as the connection between a virtual server and its physical home is not necessarily as clear. Almost any hypervisor offers the ability to extract the necessary data to do accurate chargeback of virtual machines. However, most of the platforms do not make this process very easy. Typically, a third-party tool or business intelligence reporting structure will need to be implemented to resolve this particular thorny issue.
In a chargeback program, it may be easy for the business units to start seeing the data center as just another utility service—one that exists solely for each business unit. This means it may become difficult to analyze technology trends, forecast services for the company, or even train staff adequately because there is no business unit willing to pay for that work.
Virtualization:
What will the customer base really use? Virtual CPU capacity, Disk IO, Network IO, or even Memory Loading? What if your cost model is based on just one or two capacities, but all your clients end up using more of one of the others you did not base your cost model on?
Even worse, after you figure out some cost factor for Virtual CPU, Network, Disk, and Memory:
- Did you really pre-provision enough or each? (Decide what you need and when you need it in reference to infrastructure; pre-provision at least what you can for the first year if you can, this is a sunken cost.)
- What about the time factor?
- If network connectivity must be preconfigured, who gets that fixed cost per month until it is fully loaded?
- Shared storage: the same issue, but you have to have network and disk resources available before the virtual host is online. (Decide how or what you will charge against, again by virtual CPU, disk, memory, and/or network resources, include all costs for the period defined, site costs, infrastructure costs.)
Organizations first need to determine the capacity and power rating for each box in their data center. A unit-based measurement system provides a clearer picture of performance so that consolidation plans can be adjusted and adapted as the technology is implemented.
The benefits of measurement extend beyond a consolidation project to performance management. Detailed measures like cost per CPU second enable organizations to see how other changes in the environment impact efficiency and cost. While these systems require an investment in terms of time and sometimes, the help of a third-party, and the ability to track and measure the impact of significant changes in the data center is invaluable. A key performance indicator (KPI) such as cost per CPU second is the best way we have to indicate the unit cost of computing value delivered.
The following are important points related to chargeback in the context of virtualization:
- Incentives are as important as cost recovery: Chargeback methods also create incentives for the service provider. For example, a “one size fits all” VM price that assumes a certain average capacity will discourage the use of “large” VMs.
- Infrastructure costs should be separate from service costs: Most successful chargeback methods do not co-mingle the cost of data center capacity (CPU, Memory, Storage, and Facilities) with the labor and tools to manage individual application and OS instances. E.g. the difference between 10 VMs with 1 GB RAM each and 1 VM with 10 GB of RAM. Each has a total of 10 GB of RAM capacity, but 10 VMs are usually much more work to manage than a single, large VM.
- Unit costs change over time: Shared infrastructure is a combination of fixed costs and variable costs. As the environment grows, the proportion of fixed costs as a percentage of the whole will decrease. In a virtual environment, there is an entry cost that typically requires two or three hosts, access to shared storage and network fabric. Incremental capacity is less expensive for each additional VM. Chargeback methods need to account for the effect of decreasing marginal costs. (1) Revise the model over time, (2) assume a long-term average steady-state environment or (3) ignore the growth effect in the cost model, allowing cost reductions to improve margins over time.
- Pricing should be tiered: Chargeback for virtual infrastructure can be tiered on several dimensions. One dimension is on capacity: assuming the “slice” based model is used, then the capacity tiers are either divided into some form of small/medium/large slice, or as slices measured in discrete units (e.g., a slice defined as 1 GHz CPU and 1 GB RAM, and a larger VM requiring 4 GB of RAM is counted as four slices).
- Bundling is a necessity: In traditional IT environments, it is simple enough for the service provider to pass on the cost of network ports, storage, server hardware, power, and floor space. Virtualization abstracts the applications and operating systems from the physical infrastructure. Then, it moves everything into a shared infrastructure. Sending the customer a bill that shows usage of network ports, power (kWh) and cooling usage (BTU) is not only wrong, but it is also almost impossible to properly calculate (e.g. they could be using fractions of network ports and may be using portions of de-duplicated storage). When it comes to infrastructure costs, it is best to roll up the core infrastructure (floor space, power, cooling, network connectivity, etc.) into a bundled infrastructure rate, since the usage of those elements tend to be correlated with actual computing usage in a virtualized world.
- Be prepared for a dynamic environment: Virtualization offers customers many more options for creating, cloning, powering on, and powering off of virtual systems. With that in mind, chargeback in this more dynamic environment must take into account three major themes:
- More self-service tools for IT infrastructure; Provisioning and management tasks are automated
- Capacity-based pricing must take into account capacity that is used on an on-demand basis
- For non-automated functions, labor used for turn-on, turn-off, cloning, etc. should not be ignored (hence the need for some self-service automation such as VMware Lifecycle Manager when the business requires such a dynamic environment).
Functions, Features, Qualities
Chargeback is a way to put IT services in terms that businesspeople understand and value. When IT is bought and consumed like other services, IT can become a business within the business. And that is the path to true IT value.
Functions
Chargeback systems and procedures need to be user-oriented. There is a tendency to present billing information in terms of Number of I/Os, Processing Time or Memory Consumed. These units have little or no meaning to most users. A desired approach is to tie system resources to business entities. This way, users see charges by items such as Customers Processed or Accounts Updated. These are areas in which users can communicate and control usage of their processing resources.
Key chargeback functions can be grouped into the following areas:
- Data Collection Functions: For example, if a cost element is based on number of transactions, then the number of transactions executed each day will have to be collected.
- Account Table Maintenance: There will most likely be some form of account table that describes the various users and departments and how system data that is collected is to be allocated across these entities. Periodic maintenance will need to be done on this table to ensure that charges are being allocated correctly based on the most current requirements of the business.
- Rate Setting: Chargeback algorithms and rates may change over time due to increased costs for services or changes in user departments. These rates need to be fairly developed, agreed upon by key users and integrated into the current procedures and systems used to do chargeback.
- Billing & Reporting: Chargeback bills and reports will have to be produced on a periodic basis.
- Administrative functions:
- Budgeting Activities
- Pricing Decisions
- Usage Variance Analysis Request
- Business General Ledger & Accounting
- Cost Allocation Decisions
- Capacity Planning & Usage Trending Activities
Features
- Maintains organizational alignment.
- Involves a business stakeholder and make the business own facets of the problem.
- Has a set of clearly defined roles and deliverables will be needed to clarify who owns what components.
- Defines service-level agreements on data, availability, etc.,
Simple IT chargeback systems are little more than straight allocations of IT costs based on readily available information, such as user counts, application counts, or even subjective estimation. At a lesser degree of complexity, an organization trades some of the effectiveness of IT chargeback for a smaller burden, in terms of time and money required to perform the chargeback.
- Chargeback Software Selection: Key requirements are to determine the charging algorithm flexibility of the product chosen, accuracy of collection and reporting, and ease of maintenance and use.
- Configuration versus Utilization Costing Strategies: When developing cost algorithms, a key decision is whether to charge based on utilization of resources [incremental charges and measuring use of cost resources] or to charge directly related to the costs of the configuration [distributes costs to user departments].
- Fixed versus Variable Cost Elements: It must be determined whether charging algorithms are to be based on fixed charges (predictable usage) versus variable charges (unpredictable usage). Reporting and billing will then have to show how rates have been applied and what amounts of the variable elements have been recorded and charged for.
- Unused or Idle Resources: It should be determined how unused or idle resources will be covered by the chargeback system.
- Overhead Resources: It should be determined how overhead resources will be accounted for. These resources tend to be used by all users (such as the Operating System). If these types of resources are to be charged to users, a fair allocation strategy needs to be determined.
- Shared Resources: It should be determined how shared resources will be covered by the chargeback system.
- Systems Software Customization: Some customization efforts for systems software may be needed to adequately measure and collect usage statistics.
- Scope of Processing Costs: The scope of processing costs needs to be determined to understand the true costs of delivering services. These categories include:
- Equipment expenses: Rental, lease, maintenance or depreciation on equipment.
- Communications expenses: Costs for lines, wiring, transmission facilities and services.
- Salary expenses: Costs for personnel used to support processing functions.
- Occupancy and facilities expenses: Costs for building space and utilities.
- Supplies expenses: Costs for supplies, forms and other non-equipment materials.
- Other allocated expenses: Costs that have been allocated to operations from other activities within the business enterprise.
- Manual Services: Chargeback activities may need to include cost items for manual services such as data entry, tape mounts, etc.
- Variable Charge Rates: It may be desirable to change charges depending on some criteria such as time of day, peak loads, priorities, etc.
- Variance Analysis: It may be desirable to compare budgeted processing expenses with those actually incurred by each user department.
- Charge Penalties: It may be desired to implement penalty costs for exceeding usage limits or processing certain types of functions at inconvenient times of the day.
Benefits
Charging back is not about creating a profit center or penalizing internal clients; it’s about running your creative services department in the most efficient manner to maximize your company’s profits. Benefits of implementing a chargeback system include:
- Increased awareness of how much it really costs to do those creative projects.
- Recognition of the value of an internal group compared to outside agencies—not just the cost, but things like brand knowledge and quick turnaround.
- Increased efficiencies by reducing those endless rounds of revision.
- Increase resource flexibility—to add staff to meet demand if you are billing for their costs.
- Transition from a cost center to a value center.
- Redefine the company as a service provider.
- Replace lengthy customized Service Level Agreements (SLAs) with a service catalog.
- Improve your cost strategy, provides the client with data for budgeting and gives your finance group the information they need to re-define their financial model.
- Better understanding of the complications and charges for requesting an IT service on the users’ part.
Applications, Use Cases, Customer Case Studies
Different models, with different classes of service, can be used to drive more cost-efficient consumption of IT and to achieve more effective matching of service to business need. Four basic methods for pricing IT value are described below.
Tools
- Open source web based service level management software
- VMware vCenter Chargeback Manager
- Utility Chargeback
Evaluator’s Analysis, Comments, and Recommendations
Strengths
- IT needs to understand that the least costly way to run any IT operation of significant size is with a well-performing internal operation, and having a chargeback system in place that links costs to services is not going to make outsourcing more likely.
- The chargeback model also provides IT a more meaningful way of measuring the cost of their services in a way that makes sense to end-users. Improvements in processes will result in increased value of the service and/or reduced chargeback that will have a clear impact on the profitability of the business units. Business units appreciate the transparency and will tend to make fewer inaccurate assumptions about the value of their services.
- A chargeback model facilitates replacing multiple service-level agreements with a standard service catalog.
- Chargeback and other methods of demand management help organizations prioritize their IT projects.
Weaknesses
- Internal politics associated with implementing and maintaining IT chargeback systems to be daunting when combined with administrative costs and substantial accounting challenges.
- IT departments may also fear that linking actual costs to value delivered sets them up for comparisons to commercial service providers.
- A common problem with chargeback is that potential buyers start haggling with you or just go to a SaaS provider that is a few bucks cheaper.
Chargeback can lead to bad decisions because managers become more concerned about reducing their individual costs than doing what is best for the enterprise.
- Chargeback adds overhead at a time when most organizations are being told to cut back.
Internal customers have a hard time understanding all the costs required to support applications.
Recommendations
- Build a “best practices” chargeback process.
- Develop a chargeback requirements document.
- Evaluate and select chargeback software.
- Implement the chargeback software.
- Build a finance and chargeback support team dedicated to IT management.
Conclusion
IT chargeback can work, but it is important to plan the process, track using accounting principles, and then watch for any fallout that can occur with the chargeback program.
Glossary
- Operational Cost: Operational costs may include expenditures for staffing, hardware maintenance, electricity, software procurement, storage rental, and security. Operational costs are usually calculated quarterly or annually.
- Accounting: Accounting is used for monitoring and controlling operational costs and can be used for capacity management and budgeting expenses.
- Chargeback: Chargeback is a general term that can be used to represent either
charging of resource usage to different business units of the same company,
or billing other companies based on their resource usage.
- Billing: Total Operational Cost + Gross Profit Margin.
References
http://www.sourcingmag.com/dictionary/Chargeback_system-34.htm
http://whatis.techtarget.com/definition/it-chargeback-system.html
http://searchservervirtualization.techtarget.com/tip/0,289483,sid94_gci1293068_mem1,00.html
http://www.cio.com/article/27821/Chargeback_Demonstrates_IT_Value_in_the_enterprise
http://searchcio.techtarget.com/news/1516352/IT-chargeback-A-fundamental-part-of-cloud-computing-takes-shape
http://www.ibmsystemsmag.com/aix/aprilmay07/features/11804p1.aspx
http://www.b-eye-network.com/blogs/krishnan/archives/2008/04/successful_char.php
http://blogs.msdn.com/b/nickmalik/archive/2007/09/18/soa-economic-model-avoiding-chargebacks-with-transaction-ratio-funding.aspx
http://www.itbusinessedge.com/cm/docs/DOC-1620
http://vpivot.com/2010/06/24/private-clouds-people-consolidation-and-chargeback/
http://searchcio.techtarget.com/tutorial/IT-chargeback-management-tips-and-turnoffs
http://www.ssonetwork.com/topic_detail.aspx?id=424&ekfrm=6
http://findarticles.com/p/articles/mi_m0SMG/is_n8_v13/ai_13901687/
http://social.msdn.microsoft.com/Forums/en-US/windowsazure/thread/f191c3f5-f867-4eee-a043-0d16c4682358
http://searchcloudcomputing.techtarget.com/news/article/0,289142,sid201_gci1514361_mem1,00.html
About Mitesh Soni
Research Engineer at iGATE Patni
I am working as a Research Engineer. I have been in the domain of Research from the beginning of my career.
I have explored XBRL, UBmatrix, Coyote, JREX, JetS3t API to access Eucalyptus Private Cloud, One Jar Utility, ProGuard Obfuscator, Hadoop, Amazon Web Services, Right Scale Management Tool, Cloud Security, Cloud Governance and so on.