Abstract: This paper presents a broad view of management of design and implementation of power systems for Data Centers. The paper outlines many challenges that are present because of the demanding requirements of Data Centers both in design and management, then introduces opportunities that recent technological advances have made possible. This paper presents several new approaches of ownership and responsibilities that directly affect financial viability of the Data Center.
The American Society of Heating, Refrigerating, and Air Conditioning Engineers (ASHRAE) is an ANSI-accredited continuous-maintenance standards developer (a major contributor to what we call a regulatory product development “stream”). Continuous maintenance means that changes to its consensus products can change in as little as 30 days so it is wise to keep pace.
Among the leading titles in its catalog is ASHRAE 90.1 Energy Standard for Sites and Buildings Except Low-Rise Residential Buildings. Standard 90.1 has been a benchmark for commercial building energy codes in the United States and a key basis for codes and standards around the world for more than 35 years. Free access to ASHRAE 90.1 version is available at the link below:
Redlines are released at a fairly brisk pace — with 30 to 45 day consultation periods. A related title — ASHRAE 189.1 Standard for the Design of High Performance Green Buildings — first published in 2009 and far more prescriptive in its scope heavily references parent title 90.1 so we usually them as a pair because 189.1 makes a market for green building conformance enterprises. Note the “extreme prescriptiveness” (our term of art) in 189.1 which has the practical effect of legislating engineering judgement, in our view.
Education estate managers, energy conservation workgroups, sustainability officers, electric shop foreman, electricians and front-line maintenance professionals who change lighting fixtures, maintain environmental air systems are encouraged to participate directly in the ASHRAE consensus standard development process.
We also maintain ASHRAE best practice titles as standing items on our Mechanical, Water, Energy and Illumination colloquia. See our CALENDAR for the next online meeting; open to everyone.
Issue: [Various]
Category: Mechanical, Electrical, Energy Conservation, Facility Asset Management, US Department of Energy, #SmartCampus
Colleagues: Mike Anthony, Larry Spielvogel, Richard Robben
* Many standards-developing organizations aim to broaden their influence by entering the product standard and certification domain. Although our primary focus is on interoperability standards (within a system of interoperable products), we also consider market dynamics when product performance specifications are incorporated by reference into public law.
To paraphrase Marc Andreessen: “Building standards are eating the world and ASHRAE is eating building standards” (– Mike Anthony, University of Michigan). Just when you thought ASHRAE’s claim to energy regulation could not get any larger, it has recently appropriated everything *between* buildings in its scope — that means all above-ground pathway lighting, steam, hot water communication cabling tunnels, water pumps, fire protections systems; among others.
Best wiring safety practice for the illumination of educational settlement occupancies is scattered throughout the National Electrical Code with primary consideration for wiring fire safety:
Article 410 – Covers the installation of luminaires (fixtures), lampholders, and lamps, including requirements for wiring, grounding, and support.
The renovated Schwarzman Center at Yale now features dynamic new communal areas, a refreshed historic dining hall and eye-catching exterior lighting, enhancing the campus experience.
“…LIGHT + DESIGN was developed to introduce architects, lighting designers, design engineers, interior designers, and other lighting professionals to the principles of quality lighting design. These principles; related to visual performance, energy, and economics; and aesthetics; can be applied to a wide range of interior and exterior spaces to aid designers in providing high-quality lighting to their projects.
Stakeholders: Architects, interior designers, lighting practitioners, building owners/operators, engineers, the general public, luminaire manufacturers. This standard focuses on design principles and defines key technical terms and includes technical background to aid understanding for the designer as well as the client about the quality of the lighted environment. Quality lighting enhances our ability to see and interpret the world around us, supporting our sense of well-being, and improving our capability to communicate with each other….”
Illumination technologies run about 30 percent of the energy load in a building and require significant human resources at the workpoint — facility managers, shop foremen, front-line operations and maintenance personnel, design engineers and sustainability specialists. The IES has one of the easier platforms for user-interest participation:
Because the number of electrotechnology standards run in the thousands and are in continual motion* we need an estimate of user-interest in any title before we formally request a redline because the cost of obtaining one in time to make meaningful contributions will run into hundreds of US dollars; apart from the cost of obtaining a current copy.
We maintain the IES catalog on the standing agendas of our Electrical, Illumination and Energy colloquia. Additionally, we collaborate with experts active in the IEEE Education & Healthcare Facilities Committee which meets online 4 times monthly in European and American time zones; all colloquia online and open to everyone. Use the login credentials at the upper right of our home page to join us.
Information and communications technology (ICT) is a fast-moving economic space in which a mix of consensus, consortia and open-source standards form the broad contours of leading practice. ICT standards tend to follow international developments — more so than, say, fire safety standards which are more familiar to education facility leadership. All school districts, colleges, universities and university-affiliated health care systems have significant product, system, firmware and labor resources allocated toward ICT.
The Building Industry Consulting Service International (BICSI) is a professional association supporting the advancement of the ICT community in all markets. This community is roughly divided between experts who deal with “outside-plant” systems and “building premise” systems on either side of the ICT demarcation (or Point-of-Presence). BICSI standards cover the wired and wireless spectrum of voice, data, electronic safety & security, project management and audio & video technologies. Its work is divided among several committees as shown in the landing page of its standards setting enterprise, linked below:
The stars on the map above indicate where BICSI Standards are currently in use (CLICK ON IMAGE).
Education communities are stewards of significant information and communication technology infrastructure. Accordingly, we track the development of BICSI 009 Data Center Operations and Maintenance Best Practices. This title provides requirements, recommendations, and best practices for the operation and maintenance of data centers including but not limited to standard operating procedures, emergency operating procedures, maintenance, governance, and management. Those comments are now being integrated into a revised standard to be released as soon as the restrictions of the pandemic are eased. For more information you may communicate directly with Jeff Silveira (jSilveira@bicsi.org)
As of this posting, all BICSI best practice titles are stable and current; though our recent communication with its leadership indicates that BICSI standards setting has been slowed by the pandemic.
A fair amount of content in BICSI standards are inspired by movement in safety concepts of the National Electrical Code; particularly on matters involving wiring, grounding and lightning protection. We maintain all BICSI best practice titles on the standing agenda of our Infotech 200 teleconference. See our CALENDAR for the next online meeting; open to the public. On this topic we collaborate with the IEEE Education & Healthcare Facilities Committee meets four times monthly in European and American time zones; also open to the public.
Did you know BICSI offers a complete library of our award winning technical manuals and published standards? Available in print or electronic download, this set is a perfect resource for your company. Learn more: https://t.co/fzBA8hqve9pic.twitter.com/y9duVe0fCG
“Le Lac Léman ou Près d’Evian au lac de Genève” 1883 François BocionISO and IEC Joint Technical Committee 1 is the work center for international information and communications technology (ICT) standards that are relevant to education communities. In accordance with ISO/IEC JTC 1 and the ISO and IEC Councils, some International Standards and other deliverables are made freely available for standardization purposes.
We at least follow action, and sometimes contribute data and user-interest perspective, to the development of standards produced by several ANSI-accredited ICT standard developing organizations — ATIS, BICSI, IEEE, INCITS, TIA among them. US-based organizations may communicate directly with Lisa Rajchel, ANSI’s ISO/IEC JTC 1 Senior Director for this project: lrajchel@ansi.org. Our colleagues at other educational organizations should contact their national standards body.
We scan the status of Infotech and Cloud standards periodically and collaborate with a number of IEEE Societies. See our CALENDAR for the next online meeting; open to everyone.
“Mount Fuji from Lake Yamanaka” Takahashi Shōtei (1871-1945) | Los Angeles County Museum of Art
The Japanese Standards Association is the Global Secretariat for a standardization project devoted to the discovery and promulgation of common methods and guidelines for coordinated lifetime management of network assets in power systems to support good asset management. In addition, this may include the development of new methods and guidelines required to keep pace with development of electrotechnologies excluding generation assets; covered by other IEC standards.
There has, and will continue to be significant investment in electricity assets which will require ongoing management to realise value for the organizations. In the last 5 years, there has been USD 718 billion investment for electricity, spending on electricity networks and storage continued, reaching an all-time high of USD 277 billion in 2016. In the United States (17% of the total) and Europe (13%), a growing share is going to the replacement of ageing transmission and distribution assets. A more fully dimensioned backgrounder on the business environment that drives the market for this title is available in the link below:
It is early in this project’s lifecycle; far too early to find it referenced in public safety and energy laws in the United States where it would affect #TotalCostofOwnership. Where we should, we follow the lead of the USNC/IEC for the United States, while still mindful that many of our IEEE colleagues follow the lead of their own national standards body.
Because this project fills an obvious gap in good practice literature we maintain this project on our 4 times monthly electrotechnology colloquium that we co-host with the IEEE Education & Healthcare Facilities Committee. See our CALENDAR for the next online meeting; open to everyone.
US K-12 schools (public school districts) spend approximately $8 billion annually on energy costs, including electricity, which ranks as the second-largest operating expense after teacher salaries. This figure, cited by the U.S. Department of Energy and EPA, reflects nationwide totals, with much of it electricity-related due to lighting, HVAC, and other needs; efficiency improvements could save 10-30%.
For colleges and universities, specific nationwide electricity or total energy cost aggregates are less uniformly reported in recent sources, but higher education institutions face substantial utility bills—often over $100,000 per large building annually—with campuses consuming significant power for 24/7 operations, research labs, and facilities.
US healthcare systems, particularly hospitals, incur high electricity costs due to continuous operation and intensive equipment use. Individual hospitals often pay $600,000 to over $2 million yearly on electricity alone, with average energy costs around $3-4 per square foot; inpatient facilities consume nearly twice the electricity per square foot of average commercial buildings.These sectors represent major institutional energy consumers, where efficiency upgrades yield significant savings.
The Federal Energy Regulatory Commission is an independent agency within the U.S. federal government that regulates interstate transmission of electricity, natural gas, and oil. It oversees wholesale energy markets, pipeline infrastructure, and hydroelectric projects, ensuring fair rates and reliability. While independent, FERC operates under the Department of Energy’s umbrella but does not take direct orders from the executive branch.
FERC enforces energy laws, approves infrastructure projects, and regulates market competition. FERC plays a crucial role in balancing economic, environmental, and energy security concerns, aiming to maintain a stable and efficient energy system across the United States. Since the U.S. shares interconnected electricity grids with Canada and Mexico, FERC’s decisions on transmission rules and pricing affect energy flows and grid reliability in both countries.
Our interest lies in closing a technical gap that exists upstream from the building service point and downstream from the utility supply point. Some, not all of it, can be accomplished with titles in the IEEE catalog.
Given the dominance of vertical incumbents in the electric power domain, we have submitted a tranche of reliability concepts into the ASHRAE, NFPA and ICC catalogs — not so much with the expectation that they will be gratefully received — but that our proposals will unleash competitive energies among developers of voluntary consensus standards.
One of our proposals was heard at the April-May and October meetings of the International Code Council. We are happy to discuss the outcome of that proposal any day at the usual hour.
In power system engineering, availability and reliability are two important concepts, but they refer to different aspects of the system’s performance.
Reliability:
Reliability refers to the ability of a power system to perform its intended function without failure for a specified period under given operating conditions. It is essentially a measure of how dependable the system is.
Reliability metrics often include indices such as the frequency and duration of outages, failure rates, mean time between failures (MTBF), and similar measures.
Reliability analysis focuses on identifying potential failure modes, predicting failure probabilities, and implementing measures to mitigate risks and improve system resilience.Availability:
Availability, on the other hand, refers to the proportion of time that a power system is operational and able to deliver power when needed, considering both scheduled and unscheduled downtime.
Availability is influenced by factors such as maintenance schedules, repair times, and system design redundancies.
Availability is typically expressed as a percentage and can be calculated using the ratio of the uptime to the total time (uptime plus downtime).
Availability analysis aims to maximize the operational readiness of the system by minimizing downtime and optimizing maintenance strategies.
Reliability focuses on the likelihood of failure and the ability of the system to sustain operations over time, while availability concerns the actual uptime and downtime of the system, reflecting its readiness to deliver power when required. Both concepts are crucial for assessing and improving the performance of power systems, but they address different aspects of system behavior.
Comment:These 1-hour sessions tend to be administrative in substance, meeting the minimum requirements of the Sunshine Act. This meeting was no exception. Access to the substance of the docket is linked here.
On Monday June 13th, Federal Energy Regulatory Commission commissioners informed the House Committee on Energy and Commerce that the “environmental justice” agenda prohibits reliable dispatchable electric power needed for national power security. One megawatt of natural gas generation does not equal one megawatt of renewable generation. The minority party on the committee — the oldest standing legislative committee in the House of Representatives (established 1795) — appears indifferent to the reliability consequences of its policy.
“Our nation’s continued energy transition requires the efficient development of new transmission infrastructure. Federal and state regulators must address numerous transmission-related issues, including how to plan and pay for new transmission infrastructure and how to navigate shared federal-state regulatory authority and processes. As a result, the time is ripe for greater federal-state coordination and cooperation.”
At the July 20th meeting of the Federal Energy Regulatory Commission Tristan Kessler explained the technical basis for a Draft Final Rule for Improvements to Generator Interconnection Procedures and Agreements, On August 16th the Commission posted a video reflecting changes in national energy policy since August 14, 2003; the largest blackout in American history.
“Landscape with a Farm House and Windmill” (1680) / Jacob Isaaksz van Ruisdael
We have always taken a forward-looking approach to the National Electrical Code (NEC) because there is sufficient supply of NEC instructors and inspectors and not enough subject matter experts driving user-interest ideas into it. Today we approach the parts of the 2023 NEC that cover wiring safety for microgrid systems; a relatively new term of art that appropriates safety and sustainability concepts that have existed in electrotechnology energy systems for decades.
Turn to Part II of Article 705 Interconnected Electric Power Production Sources:
You will notice that microgrid wiring safety is a relatively small part of the much larger Article 705 Content. There were relatively minor changes to the 2017 NEC in Section 705.50 — but a great deal of new content regarding Microgrid Interconnection Devices, load side connections, backfeeding practice and disconnecting means — as can be seen in the transcripts of Code-Making Panel 4 action last cycle:
Keep in mind that the NEC says nothing (or nearly very little, in its purpose stated in Section 90.2) about microgrid economics or the life cycle cost of any other electrical installation. It is the claim about economic advantages of microgrids that drive education facility asset management and energy conservation units to conceive, finance, install, operate and — most of all — tell the world about them.
In previous posts we have done our level best to reduce the expectations of business and finance leaders of dramatic net energy savings with microgrids — especially on campuses with district energy systems. Microgrids do, however, provide a power security advantage during major regional contingencies — but that advantage involves a different set of numbers.
Note also that there is no user-interest from the education facility industry — the largest non-residential building construction market in the the United States — on Panel 4. This is not the fault of the NFPA, as we explain in our ABOUT.
The 2023 NEC was released late last year.
The 2026 revision cycle is in full swing with public comment on the First Draft receivable until August 24, 2024. Let’s start formulating our ideas using the 2023 CMP-4 transcripts. The link below contains a record of work on the 2023 NEC:
We collaborate with the IEEE Education & Healthcare Facility Committee which meets online 4 times per month in European and American time zones. Since a great deal of the technical basis for the NEC originates with the IEEE we will also collaborate with other IEEE professional societies.
Mike Anthony’s father-in-law and son maintaining the electrical interactive system installed in the windmill that provides electricity to drive a pump that keeps the canal water at an appropriate level on the family farm near Leeuwarden, The Netherlands.
Best practice literature to be covered in our 11 AM session today are listed below. These codes and standards ensure safety, reliability, and compliance for underground electrical and telecommunications installations:
Relevance: The NEC, published by the National Fire Protection Association, is the primary standard for safe electrical installations in the U.S. Articles 300 (Wiring Methods), 310 (Conductors for General Wiring), and 230 (Services) cover underground wiring, including burial depths, conduit requirements, and direct-burial cables like Type UF and USE-2. For example, NEC 300.5 specifies minimum cover depths (e.g., 24 inches for direct-burial cables, 18 inches for PVC conduit).
Key Aspects: Rules for conductor protection, grounding, GFCI requirements, and conduit types (e.g., Schedule 80 PVC). Adopted by most U.S. jurisdictions with local amendments.
ANSI/TIA-568 Series (Commercial Building Telecommunications Cabling Standards)
Relevance: Governs low-voltage telecommunications cabling, including underground installations. TIA-568.2-D (Balanced Twisted-Pair) and TIA-568.3-D (Optical Fiber) specify performance requirements for cables like Cat6 and fiber optics, including maximum distances (e.g., 100 meters for twisted-pair).
Key Aspects: Ensures signal integrity, proper separation from high-voltage lines, and compliance for plenum or direct-burial-rated cables. Voluntary unless mandated by local codes.
IEEE 835 (Standard Power Cable Ampacity Tables)
Relevance: Provides ampacity ratings for underground power cables, critical for sizing conductors to prevent overheating.
Key Aspects: Includes data for direct-burial and ducted installations, considering soil thermal resistivity and ambient conditions. Often referenced alongside NEC for high-current applications.
UL 83 (Standard for Thermoplastic-Insulated Wires and Cables)
Relevance: Underwriters Laboratories standard for wires like THWN-2, commonly used in underground conduits. Ensures cables meet safety and performance criteria for wet locations.
Key Aspects: Specifies insulation durability, temperature ratings, and suitability for direct burial or conduit use. NEC requires UL-listed cables for compliance.
OSHA 1910.305 (Wiring Methods, Components, and Equipment)
Relevance: U.S. Occupational Safety and Health Administration standard for workplace electrical safety, including underground installations in industrial settings.
Key Aspects: Specifies approved wiring methods (e.g., armored cable, conduit) and enclosure requirements for underground cable trays or boxes. Focuses on worker safety during installation and maintenance.
CSA C22.1 (Canadian Electrical Code)
Relevance: Canada’s equivalent to the NEC, governing underground electrical installations. Similar to NEC but tailored to Canadian conditions and regulations.
Key Aspects: Defines burial depths, conduit types, and grounding requirements. For example, low-voltage cables (<30V) require 6-inch burial depth, like NEC.
Notes:
Regional Variations: Always consult local building authorities, as codes like the NEC or AS/NZS 3000 may have amendments. For example, some U.S. states reduce burial depths for GFCI-protected circuits (NEC 300.5).
Low-Voltage vs. High-Voltage: Standards like TIA-568 and ISO/IEC 11801 focus on low-voltage (e.g., <50V) telecommunications, while NEC and IEC 60364 cover both power and telecom.
Practical Compliance: Before installation, call 811 (U.S.) or equivalent to locate underground utilities, and obtain permits/inspections as required by local codes.
Critical Examination: While these standards are authoritative, they can lag behind technological advancements (e.g., new cable types like GameChanger exceeding TIA-568 limits). Over-reliance on minimum requirements may limit performance for cutting-edge applications.
New update alert! The 2022 update to the Trademark Assignment Dataset is now available online. Find 1.29 million trademark assignments, involving 2.28 million unique trademark properties issued by the USPTO between March 1952 and January 2023: https://t.co/njrDAbSpwBpic.twitter.com/GkAXrHoQ9T
