Wednesday, October 25, 2017

Data Center Design Consideration: Meet Me Rooms (MMR)

A co-location facility / carrier-neutral data center hosts services from multiple carriers (telecommunication companies) or organizations. Meet-me rooms (MMR) are important physical spaces (2 or more for redundancy) located in the building of a co-location data center or carrier-neutral data center. Data center clients use this space to interconnect or cross-connect to a single or multiple carriers (for redundancy) and to exchange information, which can be transmitted to individual computers via the Internet, without incurring local-loop fees.




Although the concept and practice of using an MMR are not new, the initial creation and management of these spaces over time has become a serious challenge for operators. Owing to some poor practices and lack of building standards, there have been occasions where new clients' preferred carrier could not be accommodated as a result of physical / location challenges. We are going to outline some design best practices.



CABINETS AND SPACE


A carrier generally asks for at least 2 four-post, 84" (45U) high cabinets in each MMR. If the operator is providing only AC power, the carrier may request additional rack space for rectifiers and batteries, should they be using DC equipment.

The best practice is to meet with the intended carriers all at once to create a rack and space solution that they can all agree on. Although this may be a difficult task to schedule, it will be worthwhile to reach an agreement on one typical rack type and one layout look and feel.

Clients who inspect your facilities before signing a contract will appreciate a consistent look to this space. Permitting odd-size cabinets combined with open-frame racks of all colors and widths will detract from a professional look and limit the usefulness of space for new or different functions.

Meet-Me Rooms tend to be smaller because fibers would be run from a user suite to patch panels in an MMR to be interconnected, which requires little space. With time, these rooms have grown in size and are starting to resemble data centers, including features such as cages.



LOCATION


The location of the MMRs would be outside the computer rooms, in the secure data center space. When determining location for one or redundant rooms, consider the industry standards for distance, which will vary according to service type and media (fiber/copper/coax). Placing the MMR on an outside wall is ideal if the space will double as the point of entry so that equipment and workers can go in and out using external doors without disrupting data hall's operations.

Depending on the expected user population, locating the MMR on an exterior wall and even near a loading dock could be a deal breaker for security reasons. If your clients require significantly more security than normal commercial businesses, the MMR should not act a main point of entry but should instead be placed within the data center, away from external walls.



CONNECTIONS


The connection to the data center clients and carriers / MMRs have many methods. Some standards exist. Each method has challenges in co-location facilities, and each challenge can be met so long as they are identified early and planned for.


Direct Connect —

Each carrier connects directly with the client from the carrier-equipment rack to the client-side demarcation point or equipment rack which is also located in a secure half of the MMR (see figure below). The client then extends to the floor space.

The MMR is split for security reasons between clients and carriers. Clients are permitted in their side of the MMR, and carriers in theirs. This approach could increase the amount of conduit in the ceiling space and limit future installations.

Using a private cage for client-side equipment or third-party cross-connect provider as the only staff permitted in the client side of the MMR could limit a security concern.




Direct Connect (Extended Demarcation Point) —

It means each carrier connects directly with the client from the carrier-equipment rack in the MMR to the client-side demarcation point located in the client space (see figure below). Multiple conduits demanded by clients can quickly fill any available space above the ceiling.




Cross Connect in the MMR —

Each client space has pre-installed patch panels located in a secure side of the MMR whereby multiple carriers cross-connect (see figure below). The pre-installed facility is then patched to the client's equipment in the floor space.

Similar to the "Direct Connect" method, some clients may express security concerns with this topology and carriers may not like the potential that a competitor could accidentally unplug their patch. If the MMR is professionally managed (which is highly recommended), the carrier would not have access to this side of the MMR.





Cross Connect in Client's Floor Space —

Patch panels are placed in each carrier’s secure equipment rack and pre-connected to each client's space (see figure below). Drawbacks include higher upfront costs to carriers and operators, who may never connect to every client, and loss of operator cross-connect fees.





MANAGING  MMR


Try to create in-building standards and include them in every lease agreement. In addition, carrier agreements should include adherence to your standards. These standards need to outline access-control, cross-connect, interconnect, and direct-connection means and methods, as well as installation and pathway standards, cable count and color standards, and labeling criteria.




Access Control —

Control access to carrier sides and, if designed, client sides of the MMRs. Only permit third-party MMR management companies to have access to both rooms. Make sure this access is authorized, authenticated and audited. Ensure the design disables any opportunity for a carrier or tenant to literally “throw a cable over the wall” to make a connection.


Connection Methods —

A good cable installer can be assigned to the task of managing the MMR as long as the standards are well documented and SLAs between that company and the operator exist.


Pathway Standards —

The MMR space above the ceiling is not limitless; as such, controls must be put in place to ensure large (and typically unused) conduits are not positioned between data connection points. Traditional cable tray is a sure means of transporting media; most clients will claim that cable trays are an inherent security risk, however. The use of flexible armored cable is something all operators should consider. It is lightweight, able to bend and ultra-thin compared with conduit.


Color Codes —

Color coding the media is a best practice for many reasons. Colors can designate fiber-types, counts, installation dates and specific client connections. Mining out the infrastructure of past clients is easy once the cables are identified, and identification by color is a quick means of disposal.



For details of the MMR and structured cabling system design (copper and fiber cables), please consider to attend a credential program and further learning for telecommunications spaces, horizontal and backbone distribution systems.



About SMA

Strategic Media Asia (SMA) is one of the approved CPD course providers of the Chartered Institution of Building Services Engineers (CIBSE) UK.

The team exists provide an interactive environment and opportunities for members of ICT industry and facilities' engineers to exchange professional views and experience.

SMA connects IT, Facilities and Design. For accreditation details and background, please visit www.stmedia-asia.com/about.html.



Understand the Cooling and Ventilation System Design for Data Center


Air Conditioning System Design for Data Center
(23 - 24 March 2017, approved CPD course by CIBSE UK)


It targets to engineers involved in designing or handling HVAC (Heating, Ventilation and Air Conditioning) equipment for mission critical facilities, IT infrastructure and data center projects.

All sessions highlight design principles such as psychrometric chart, cooling load calculation / estimation, etc. and the design considerations such as air distribution, availability / redundancy, common mistakes, Computer Fluid Dynamic (CFD) model, integration with MEPs (Mechanical, Electrical and Plumbing system), etc.

You'll be able to make informed decisions about the best choices of cooling systems for mission critical purposes and how system can best meet the project goal and SLA (Service Level Agreement).


Date: 23 - 24 March 2017 (Thursday - Friday)
Time: 10:00 - 17:30
Venue: 14/F, On Lok Yuen Building, 25-27A Des Voeux Road Central, Hong Kong
Fee: Special rate for CIBSE / HKIE all membership classes



> Datacom Equipment Power Trends and Cooling Applications

-- Load trends and their application
-- Air cooling of computer equipment
-- Liquid cooling of computer equipment


> Design Consideration

-- Design criteria
-- HVAC load
-- Computer room cooling
-- Air distribution
-- Liquid cooling
-- Availability and redundancy
-- Controls
-- Integration with other MEP (Mechanical, Electrical and Plumbing) system
-- Computer Fluid Dynamics (CFD)


> Testing and Commissioning

-- Air cleanliness test
-- Heat load test
-- Factory acceptance test
-- Site acceptance test
-- Integrated performance test (IST)


> Energy Efficiency

-- Power usage effectiveness
-- Chilled water plant optimization
-- Water side and air side equipment
-- Part load operation
-- Controls and energy management
-- LEED certified data center
-- Building energy code


> Sustainable Design

-- Combined heat power plant (CHP)
-- Solar cooling
-- Geothermal cooling
-- Evaporative cooling
-- Air side economizers
-- Desiccant unit


For details, please visit http://www.stmedia-asia.com/newsletter_6.html.





Get Ready to Become a Registered Specialist Contractor (Ventilation)
(29 April & 6 May 2017, Saturday)


Designed for enterprises in ventilation / air-conditioning engineering - Technical Director (TD), Authorized Signatory (AS) or other officers, our speaker introduces the register requirement, interview technique, Buildings Ordinance, ventilation and fire safety, occupational safety, health and environmental protection, etc.

The preparatory course helps local engineers and enterprises to facilitate compliance with the Buildings Ordinance in Hong Kong and to get ready to become a Registered Specialist Contractor for Ventilation Works (RSC-V).


Date: 29 April + 6 May 2017 (Saturday) - 11th round
Time: 9:00 - 13:00 / 13:30
Venue: 14/F, On Lok Yuen Building, 25-27A Des Voeux Road Central, Hong Kong
Fee: Early bird discount available for payment & application made before March 17, 2017


The RSC-V preparatory course is also available online www.stmedia-asia.com/aircon.html.





About us


Strategic Media Asia (SMA) is one of the approved CPD course providers of the Chartered Institution of Building Services Engineers (CIBSE) UK. The team exists to provide an interactive environment and opportunities for members of ICT industry and facilities' engineers to exchange professional views and experience.

SMA connects IT, Facilities and Design. For the Data Center Consideration Series, please visit 


(1) Site Selection,
(2) Space Planning,
(3) Cooling,
(4) Redundancy,
(5) Fire Suppression,
(6) Meet Me Rooms,
(7) UPS Selection, and
(8) Raised Floor

All topics focus on key components and provide technical advices and recommendations for designing a data center and critical facilities.



Data Center Design: Codes and Standards

Data center is a dedicated space where it houses the most important information and it being safe and accessible. Best practices ensure that you are doing everything possible to keep it that way.

Best practices mean different things to different people and organizations. We are going to focus on the major best practices - codes, design standards, and operational standards -  applicable across all types of data centers, including enterprise, colocation, and internet facilities. We will explore the best practices with respect to facility conceptual design, space planning, building construction, and physical security, as well as mechanical, electrical, plumbing, and fire protection. Facility operations, maintenance, and procedures will be the final topics for the series.




Following suitable codes and standards would seem to be an obvious direction when designing new or upgrading an existing data center. Data center design and infrastructure standards can range from national codes, like the NFPA (National Fire Protection Association), to local codes, like the New York State Energy Conservation Construction Code, and performance standards, like the Uptime Institute’s Tier Standard. Green certifications, such as LEED and Energy Star are also considered but optional.




Codes must be followed when designing, building, and operating your data center, but “code” is the minimum performance requirement to ensure life safety and energy efficiency in most cases. A data center is probably the most expensive facility your company ever builds or operates. Should it have the minimum requirement by code? It is clear from past history that minimum code requirement is not the best practice. Minimum requirement for fire suppression would involve having wet pipe sprinklers in your data center. However, it is definitely not a best practice for your critical facilities.



Major Data Center Standards

The major data center design and infrastructure standards developed for the industry include :-


Uptime Institute’s Tier Standard




This standard develops a performance-based methodology for the data center during the design, construction, and commissioning phases to determine the resiliency of the facility with respect to four Tiers or levels of redundancy/reliability. The Tiers are compared in our previous post below and can be also found in greater definition in the "Tier Classifications Define Site Infrastructure Performance". The origins of the Uptime Institute (UI) as a data center users group established it as the first group to measure and compare a data center’s reliability. It is a for-profit entity that will certify a facility to its standard, for which the standard is often criticized.

(1) Data Center Tier Levels and Uptime
(2) More about Data Center Tier Levels


ANSI/BICSI 002-2014


Data Center Design and Implementation Best Practices by BICSI - The standard covers the major aspects of planning, design, construction, and commissioning of the MEP (Mechanical, electrical, and plumbing) building trades, as well as fire protection, IT installation and maintenance. It is arranged as a guide for data center design, construction, and operation. Ratings / Reliability is defined by Class 0 to 4 and certified by BICSI-trained and certified professionals.


TIA Standard



Telecommunication Industry Association (TIA) for Data Center Infrastructure Design Standards: This standard is more IT cable and network oriented and has various infrastructure redundancy and reliability concepts based on the Uptime Institute’s Tier Standard. In 2013, Uptime Institute requested that TIA stop using the Tier system to describe reliability levels, and TIA switched to using the word “Rated” instead of “Tiers”, defined as Rated 1-4. TIA uses tables within the standard to easily identify the ratings for telecommunications, architectural, electrical, and mechanical systems.


TIA has a certification system in place with dedicated vendors that can be retained to provide facility certification.


EN 50600 International Standard

The European Committee for Electrotechnical Standardization (CENELEC) develops European standards for electrical engineering. The committee represents the interests of 33 member countries and 13 affiliate member countries for the European marketplace. Their standards pattern with those developed by the International Electrotechnical Commission (IEC).

The New European Standard for Data Center Facilities and Infrastructure Design is the EN 50600-X series. Many aspects of this standard reflect the UI, TIA, and BCSI standards. Facility ratings are based on Availability Classes, from 1 to 4. Approved CENELEC Standards include




EN 50173 series: Information technology - Generic cabling systems

EN 50173-1: General requirements
EN 50173-2: Office premises
EN 50173-3: Industrial premises
EN 50173-4: Homes
EN 50173-5: Data centers
EN 50173-6: Distributed building services

EN 50174 series: Information technology - Cabling installation

EN 50174-1: Installation specification and quality assurance
EN 50174-2: Installation planning and practices inside buildings
EN 50174-3: Installation planning and practices outside buildings
TR 50174-99-1: Remote powering

EN 50600 series: Information technology - Data center facilities and infrastructures design

EN 50600-1: General concepts
EN 50600-2-1: Building construction
EN 50600-2-2: Power distribution
EN 50600-2-3: Environmental control
EN 50600-2-4: Telecommunications cabling infrastructure
EN 50600-2-5: Physical security
EN 50600-3-1: Management and operational information



Regulatory Standards

Government regulations for data centers will depend on the nature of the business and can include HIPPA (Health Insurance Portability and Accountability Act), SOX (Sarbanes Oxley) 2002, SAS 70 Type I or II, GLBA (Gramm-Leach Bliley Act), as well as new regulations that may be implemented depending on the nature of your business and the present security situation.



Operational Standards

There are also many operational standards to choose from. These are standards that guide your day-to-day processes and procedures once the data center is built:


Uptime Institute : Operational Sustainability (with and without Tier certification)
ISO 9000 – Quality System
ISO 14000 – Environmental Management System
ISO 27001 – Information Security
PCI – Payment Card Industry Security Standard
SOC, SAS70 & ISAE 3402 or SSAE16, FFIEC (USA) – Assurance Controls
AMS-IX – Amsterdam Internet Exchange – Data Center Business Continuity Standard


These standards will also vary based on the nature of the business and include guidelines associated with detailed operations and maintenance procedures for all of the equipment in the data center.



Consistency and Documentation are Key

The nature of your business will determine which standards are appropriate for your facility. If you have multiple facilities across the US, then the US standards may apply. For those with international facilities or a mix of both, an international standard may be more appropriate. The key is to choose a standard and follow it. If deviations are necessary because of site limitations, financial limitations, or availability limitations, they should be documented and accepted by all stakeholders of the facility.

Regardless of the standard followed, documentation and record keeping of your operation and maintenance activities is one of the most important parts of the process. Software management tools such as DCIM (Data Center Infrastructure Management), CMMS (Computerized Maintenance Management System), EPMS (Electrical Power Monitoring System), and DMS (Document Management System) for operations and maintenance can provide a “single pane of glass” to view all required procedures, infrastructure assets, maintenance activities, and operational issues.

Your critical facilities must meet the business mission. Data center design, construction, and operational standards should be chosen based on definition of that mission. Not all facilities supporting your specific industry will meet your defined mission, so your facility may not look or operate like another, even in the same industry.



About us


Strategic Media Asia (SMA) is one of the approved CPD course providers of the Chartered Institution of Building Services Engineers (CIBSE) UK. The team exists to provide an interactive environment and opportunities for members of ICT industry and facilities' engineers to exchange professional views and experience.

SMA connects IT, Facilities and Design. For the Data Center Design Consideration, please visit 


(1) Site Selection,
(2) Space Planning,
(3) Cooling,
(4) Redundancy,
(5) Fire Suppression,
(6) Meet Me Rooms,
(7) UPS Selection, and
(8) Raised Floor

All topics focus on key components and provide technical advice and recommendations for designing a data center and critical facilities.

Data Center Site Tour in June 2017

The team sincerely thank you for all visitors and the coordination granted by the professional data center management team in Chai Wan, Hong Kong!

The half-day visit on 2 June 2017 enables our visitors to gain an insight about the mission-critical infrastructure system (UPS system, NOC, CRAC units, etc.) supporting the data center cloud and IT services.

We look forward to cooperating with the data center and organizing the similar event in the near future!








About us

Strategic Media Asia (SMA) is one of the approved CPD course providers of the Chartered Institution of Building Services Engineers (CIBSE) UK.

The team exists provide an interactive environment and opportunities for members of data center industry and facilities' engineers to exchange professional views and experience on the mission-critical facilities and IT infrastructure system.

SMA connects IT, Facilities and Design. For accreditation details and background, please visit www.stmedia-asia.com/about.html.




Monday, October 16, 2017

InRack and InRow Cooling for Data Center

Traditional data center, computer room, and server room cooling methods cool down an entire room with cold air from centralized units to one end of the room. This approach is acceptable when power densities are minimal with few hot spots in the room. However, room-oriented designs are affected by room constraints including ceiling height, room shape, obstructions above and below the floor, rack layout, Computer room air conditioning (CRAC) units' location, power distribution, etc.




CRAC units force chilled air into a data center and around the equipment. In most cases, cooling these vast volumes of air is very inefficient. Although a hot and cold aisle containment decreases the volume, it still results in a lot of excess cooling and costs of powering the CRACs. 

So why don't consider more selective data center cooling options which work together with your CRAC units or chill specific critical loads with high efficient ways but low energy cost?




Modern data centers adopt InRack and InRow coolers (IRCs), also known as close-coupled cooling systems, because they are tailor-made for high densities of hot-running IT equipment and tight energy budgets. These cooling strategies are inherently more efficient than standard CRAC systems because it ties into the IT equipment rather than sending cooled air into the room space. They may be mounted among the IT racks / cabinets or they may be mounted overhead or under the floor.


InRack Cooling




Dedicated racks, another low-effort retrofit, offer cooling isolation. The rack operates just like a standard data center rack, but it is sealed on all sides as a self-contained system. Cool air is forced up through the rack from the bottom, running over the equipment before exiting through the top to a hot plenum, where the heat is vented or recovered as necessary.




InRow Cooling




In-row cooling systems work within a row of standard server racks. The units are standard rack height, making them easy to match with the row and couple tightly to the IT equipment to ensure efficient cooling. Systems from APC by Schneider Electric, Liebert by Emerson Network Power, Rittal and others are engineered to take up the smallest footprint and offer high-density cooling. Ducting and baffles ensure that the cooling air gets where it needs to go.


    




Compared with the room-oriented architecture, the airflow paths are shorter and more clearly defined with the close-coupled cooling systems. Smaller fans can be used due to lower volumes of chilled air; energy costs are minimized; it is easier to target air onto high-density hot spots for preferential cooling; and business continuity improves, as the failure of any one single unit in the cooling environment only affects that rack or cabinet, as opposed to the total data center or the whole aisle containment. And, as the majority of these systems are modular, it is easy and cost-effective to build in degrees of resilience, leading to higher availability across the whole data center.


About us





Strategic Media Asia (SMA) is one of the approved CPD course providers of the Chartered Institution of Building Services Engineers (CIBSE) UK. The team exists to provide an interactive environment and opportunities for members of ICT industry and facilities' engineers to exchange professional views and experience.

SMA connects IT, Facilities and Design. For the Data Center Design Consideration, please visit 
(3) Cooling,
(4) Redundancy,
(9) Code & Standards, and

All topics focus on key components and provide technical advice and recommendations for designing a data center and critical facilities.