《昆腾2010年售前技术培训PPT：2-Quantum-StorNextFSSMFX-TEK.ppt》由会员分享，可在线阅读，更多相关《昆腾2010年售前技术培训PPT：2-Quantum-StorNextFSSMFX-TEK.ppt（66页珍藏版）》请在三一文库上搜索。
1、 2010 Quantum Corporation. Company Confidential.,1,Quantum StorNext,Tec Wang（王国辉） 13916587301 昆腾上海办事处,2010-08-30, 2010 Quantum Corporation. Company Confidential.,2,Store. Share. Protect. Archive, 2010 Quantum Corporation. Company Confidential.,3,Quantum StorNext,高性能SAN文件共享系统&近线智能归档, 2010 Quantum Cor
2、poration. Company Confidential.,4,StorNext Overview,从2001年来到目前的跟踪记录 部署了4000多个全球客户 全球已经部署超过50000套客户端软件 其中400多套系统部署了文件迁移归档选件 超过200PB 的数据部署在StorNext 文件系统 支持各种不同操作系统和存储硬件平台 Windows, Linux, UNIX, Mac (OS platforms) Quantum, Sun/STK, IBM, HP, Dell, Sony, Spectralogic, Qualstar (Tape technologies) Server a
3、nd disk vendor agnostic Utilized throughout rich data content industries Broadcast, Cable & CCTV Movie and Television Production, Post-Production & Graphics Science and Engineering (Oil&Gas research, Satellite imaging) High Performance Computing (Life Sciences- genome sequencing) Audio and Video Sur
4、veillance and Mining Government & Military Internet Streaming Pre-Press, Digital Printing CAD/CAM, 2010 Quantum Corporation. Company Confidential.,5,StorNext File System Overview,Heterogeneous shared file system presents pools of storage as local-attached Purpose-built for high-performance ingest, d
5、istribution and computing environments, 2010 Quantum Corporation. Company Confidential.,6,存储要被划成多个分区 UNIX, Windows, Linux 不能共享彼此的数据文件 磁盘利用率低，维护成本高,什么是StorNext 文件系统? 存储系统 在实施StorNext 之前,StorNext 之前,Windows,Linux,HP-UX,Apple,Linux, 2010 Quantum Corporation. Company Confidential.,7,IBM AIX,什么是 StorNext
6、 文件系统？ 存储系统 实施StorNext 文件系统之后,安装StorNext 文件系统之后,AADACDBCEBACBBDAEDAED,存储变单一分区 UNIX, Windows, Linux，Apple不同操作系统平台共享同一个分区上的文件 不许额外规划存储 降低管理成本,Windows,Linux,UNIX(HP,IBM,SUN),Apple,Linux,FC SAN 或者 iSCSI 存储连接方式, 2010 Quantum Corporation. Company Confidential.,8,高性能磁盘， 与硬件厂商无关,服务器上的 SAN 客户端,工作站的分布式 LAN 客户
7、端,StorNext Distributed LAN Client Overview,GigE TCP/IP Infinband IP,光纤通道,iSCSI,CIFS / NFS,SAN 客户端 Windows、Linux、UNIX 和 Mac OS* 同时支持 iSCSI 和 FC 接入 磁盘厂商无关,分布式 LAN 客户端 可实现 95% 的线速性能 涵盖整个网关节点的负载平衡 较高的灵活性，能够承受各种干扰,NAS 和 SAN 共享访问可扩展至数千个节点，提供业界领先的性能,SAN,LAN,注：中科院网络中心HPC Linux Blade：1198个DLC Client & 16 SAN
8、 client, 2010 Quantum Corporation. Company Confidential.,9,StorNext Distributed LAN Client Overview,Extends collaboration beyond the SAN by supporting thousands nodes Highly resilient clustering via gateway servers Load balancing for optimum performance, 2010 Quantum Corporation. Company Confidentia
9、l.,10,StorNext Storage Manager Overview,Delivers transparent tiered storage and archive for preservation Directory-level policy engine data movement Supports disk, NAS, VTL, MAID and tape target devices,FC/iSCSI,StorNext SAN Clients,PRIMARY TIER,SECONDARY TIER,TAPE LIBRARY ARCHIVE,VAULT,FC/iSCSI, 20
10、10 Quantum Corporation. Company Confidential.,11,共享,保留,管理,Quantum StorNext 共享存储&数据归档,高性能磁盘， 厂商无关,服务器上的 SAN 客户端,工作站的分布式 LAN 客户端,GigE TCP/IP Infinband IP,光纤通道,iSCSI,CIFS / NFS,LAN,具备重复数据删除功能的 VTL 厂商无关,磁带库归档,操作者,Vault,大容量磁盘 /NAS 厂商无关,SAN,数据管理与移动 数据放在单独的主磁盘上 数据可移动到不同层,存储目标 第一层：针对数据管理的数据类型亲和性 第二层：SATA 和
11、NAS 第三层： VTL、MAID、重复数据删除和磁带, 2010 Quantum Corporation. Company Confidential.,12,Windows,Linux,StorNext = SAN 文件系统 + 存储分层管理套件,StorNext 文件系统,Storage Area Network,StorNext 存储分层管理套件,Consolidated Storage Architecture,Primary FC RAID,Total Data Life Management,Vault,Secondary ATA Disk,数据访问, 数据管理和数据保护,UNIX
12、,Apple,Archive Library, 2010 Quantum Corporation. Company Confidential.,13,StorNext 4.0 Data Replication,Asynchronous, File-based Replication Runs on StorNext MDC Support for IP and FC connectivity Policies are configured at a directory level and managed at both source and target locations Replicati
13、on two step process: Replicate data - Replication and Deduplicated data moves from Source to Target “continuously” Replicate namespace - Each namespace replication is a “soft” snapshot Namespace replication happens per schedule or as a result of explicit system administrator action Replication will
14、be supported for the following Source/Target configurations: FS-FS, FS-SM, SM-SM Many-to-one and one-to-many (n:1 and1:n) Multi-Threaded process, single-port and multi-port connections Uses deduplication for transport (even if data is not deduped), 2010 Quantum Corporation. Company Confidential.,14,
15、StorNext 4.0 Native File System Deduplication,Uses same Deduplication technology as DXi Operates on MDC, agnostic to hardware type or brands Operates as a post process only Policy-based selection of files (per directory) Time, size and type based Integrated with replication policies for flexibility
16、Data is first written to FS, daemon creates candidate list, then starts deduplication processes Original data can be removed or not based on policy Files can remain in primary tier with a 2nd copy in the deduplication repository Works with Storage Manager the same directory can be deduplicated, repl
17、icated, and managed Deduplicated files are re-hydrated automatically before sending to tape in a managed environment Tested to 150TB physical dedupe repository Performance dependent on MDC and Disk configuration Similar config to DXi give similar results, Array/Disk dependent as well Fully supported
18、 by Replication, 2010 Quantum Corporation. Company Confidential.,15,StorNext 4.0 Replication Performance,Performance testing to date: Replication on 1 x 1GigE link SN Replication can drive the wire at full speed. Bandwidth 107 MB/s Ongoing file system performance impacted 5 to 10 percent while repli
19、cation is active. Multi-Link Replication on 4 x 1GigE links (single job) SN Replication can drive the wire at full speed. Aggregate bandwidth 420 MB/s. Replication on 10GigE Still in process Replication many to one over 1GigE SN Replication can drive the wire at full speed 1GigE WAN replication late
20、ncy simulations with various packet delay factors SN Replication demonstrated 90% or better with line speed up to 50 milliseconds. 70% of line speed for packet delays of 100 ms 50% of line speed at about 175 ms., 2010 Quantum Corporation. Company Confidential.,16,StorNext 4.0 Distributed Data Mover
21、(DDM),Allows data movement to Storage Manager tiers to be on SAN clients (and not just the MDC) Improves throughput performance to tiered storage environments Storage Disk and Tape drives Offloads data movement operations from MDC Supports data movement to disk targets and all StorNext supported lib
22、raries and drives Recommend four tape drives per mover for optimum performance Up to 16 DDMs for each Storage Manager system Automatic load balancing of I/O via Round Robin methodology Full StorNext HA support Separately licensed feature, 2010 Quantum Corporation. Company Confidential.,17,StorNext 4
23、.0 Web Services API,A limited Web Services API will be introduced in StorNext 4.0 and will include the following calls/commands:,- Current SNAPI version 2.0.1 will also continue to be supported - Full Web Services API will be available in a future release, 2010 Quantum Corporation. Company Confident
24、ial.,18,Customers and Use Cases, 2010 Quantum Corporation. Company Confidential.,19,已被业界广泛认可,StorNext 管理着超过200PB的数据，50,000多套文件系统被部署,美国4个主要的电视广播网络由StorNext支持 超过20个有线网络巨头使用StorNext 全球的科研机构采用StorNext来做研究开发支持 高新技术的领导者们利用StorNext来支持业务, 2010 Quantum Corporation. Company Confidential.,20,StorNext Customers
25、 Internet, Post Production and Gaming,Chimney Pot Complete Post Sony Pictures Imageworks DigitalFilm Tree Dragon Digital Milagro Post Moving Picture Co. NOB Studio Hamburg Technicolor,ABC.com AOL FlyingS iMemories ITV TheS Yahoo,Nintendo Microsoft Studios Sony Computer Entertainment, 2010 Quantum Co
26、rporation. Company Confidential.,21,StorNext Customers Federal,Air Force Weather (AFWA) Attorney Generals Ball Aerospace Boeing Bureau of Land Management CIA Drug Enforcement Administration (DEA) Defense Intelligence Agency Department of Engergy Environmental Protection Agency Federal Aviation Admin
27、. (FAA) General Dynamics Internal Revenue Service (IRS) Joint Warfare Analysis Center (JWAC) Korea Meteorological Admin. Raytheon Intelligence Lockheed Martin March Air Force Base,NASA National Air and Space Intelligence Center (NASIC) National Film Board of Canada NIST NOAA National Snow and Ice Da
28、ta Center Northrop Grumman NGA NSA NRO Office of Naval Intelligence Oregon Department of Agriculture Sandia National Labs SAIC US Air Force US Army US Geological Survey US Secret Service, 2010 Quantum Corporation. Company Confidential.,22,StorNext Customers Oil & Gas and Remote Sensing (Satellite Im
29、aging),ARAMCO CGG Exxon Paradigm Geophysical UK Ltd. Schlumberger NAM Data Center Tricon Geophysical Western Geco,Digitalglobe* Digital Mapping Australia Geoeye Infoterra Surveys & Mapping,*DigitalGlobe Satellite Images, 2010 Quantum Corporation. Company Confidential.,23,StorNext Customers Education
30、,Baylor University California State University Columbia University Duke University Michigan State MIT Lincoln Labs Oregon State University Stanford University UCLA,University of Colorado University of Oslo University of Cincinnati University of Illinois University of Michigan University of Pennsylva
31、nia Health Systems University of Virginia University of Washington Vanderbilt University China NEU, 2010 Quantum Corporation. Company Confidential.,24,StorNext中国主要客户群,中科院,注：中科院网络中心HPC Linux Blade：1198个DLC Client & 16 SAN client, 2010 Quantum Corporation. Company Confidential.,25,北京电视台-BTV,截止2009年底已有
32、800多个StorNext客户端,Sub_system_1: 31 Windows Workstations,Sub_system_4: 8 Windows Workstations, and 3 RedHat Linux AS with Samba installed as NAS,Other 40+ Windows workstations across LAN can access to SAN storage via the 3 Linux Samba NAS.,Sub_system_2: 11 Windows Workstations,2 MetaData Servers, Redh
33、at Linux AS 4 Update 2,Sub_system_3: 12 Windows Workstations,中央电视台 CCTV-5,DDN S2A Disk Array,Storage Area Network,当前文件系统有100多个StorNext客户端,成都电视台 CDTV 188 个StorNext 客户端,Media Asset Management System 27 Clients, Single MDC,Non-Linear Editing System #1: 74 Clients, Failover MDCs,Non-Linear Editing Syste
34、m #2: 67 Clients, Single MDC,Recording and Transition System 20 Clients, Failover MDCs,Storage Area Network, 2010 Quantum Corporation. Company Confidential.,28,60 I/O Nodes (SNFS Clients),Computing Nodes,SAN,LAN,Computing nodes are Geodapth, Paradigm, CGG, Omega etc. SNFS Clients are the I/O nodes f
35、or the whole High Performance Computing systems, which co-ordinate and feed data to the computing nodes across LAN. There are about 60 I/O nodes, which are mostly CGG DDAM (48 nodes), and NFS servers. SNFS metadata servers are 2 Sun Solaris 9. They are failover pairs. 4 Disk Arrays are all IBM DS480
36、0, which provide 60 TB usable capacity in total.,中国BGP-Oil/Gas HPC 60 个StorNext 客户端, 2010 Quantum Corporation. Company Confidential.,29,Windows DLC serving OS images via FTP,OS Images moved in and out of DLC connected servers via custom application StorNext Storage Manager De-Dups OS Image files as
37、they are written to the archive Results 2091 OS Image Files 5001 GB Total Data 2.39GB average file size 393 GB Archive Data Size Consolidated from 112 servers down to 25 and achieved 93 % capacity savings,Tape copy for protection,CIFS/NFS,GigE TCP/IP Infiniband IP,FC/iSCSI,StorNext SAN Clients,PRIMA
38、RY TIER,SECONDARY TIER,TAPE LIBRARY ARCHIVE,STORNEXT LAN CLIENTS,FC/iSCSI,5TB EMC DMX,5TB Dedup EquaLogic,Quantum i500,Linux MDC Windows SAN Clients acting as DLC Gateways De-Dup Archive HA,StorNext: Server Image Manufacturing DELL IT System OS Images 第一期, 2010 Quantum Corporation. Company Confident
39、ial.,30,Dell 全球制造工厂 第二期逐步采用Quantum StorNext 将800台服务器缩减到230-250台, 2010 Quantum Corporation. Company Confidential.,31,Illumina Sequencing Nodes Solid3 Sequencing Nodes Solexa Sequencing Nodes Titanium Sequencing Nodes,Linux HPC cluster environment Linux SAN Clients acting as DLC Gateways HA,Each creat
40、ing over 1TB of results per day. Results moved to tape for protection and archiving. 80TB file system couldnt meet backup window. 300% improvement in the time it took to run each sequence.,Tape copy for protection Generating 10TB every 4 days,GigE TCP/IP,FC,StorNext DLC Gateway Servers,PRIMARY TIER,
41、TAPE LIBRARY ARCHIVE,DISTRIBUTED LAN CLIENTS,80-100TB FC Disk,PB of Tape,FC/iSCSI,StorNext: Life Sciences Baylor - Genome Sequencing, 2010 Quantum Corporation. Company Confidential.,32,Business Issues No formal archive system and process to manage core FOX Film Assets. Need a complete workflow to in
42、gest and manage content and to repurpose and distribute the content to generate more revenue. Project Objectives Create a centralized storage repository that provides distributed access of film assets. Build a front-end portal system that : authenticates user access, indexes for search, and provides
43、 subscriber service levels to retrieve and publish assets. Quantum Solution/Benefits Quantum StorNext File System and Storage Manager. Integrated archive capabilities to a high speed access File System Provides centralized and multi-tier data management Preservation of choice on OS, disk, and tape.
44、API to tie into custom asset management layer. Allow mutli site replication VisionMatch Differentiated Independent storage supplier that is not tied to a single System Vendor Open architecture provides the flexibility to choose and migrate to whichever technologies (OS, disk, tape) that is desired E
45、nables FOX to meet the Business Issues to formalize an archive system and process to manage their core News assets.,FOX,StorNext: Media & Entertainment FOX News Broadcast, 2010 Quantum Corporation. Company Confidential.,33,FC/iSCSI,Ethernet,PHX,DDN FC Disk,SL8500,“Vault” File System Managed FS Repli
46、cation,“WIP” File System Unmanaged FS No Replication,FC Switch,SAN Client,SAN Client - Artesia Asset Mger,NAS Gateway,StorNext: Media & Entertainment FOX News Broadcast, 2010 Quantum Corporation. Company Confidential.,34,StorNext User: Media & Entertainment CNN,Business Issues No formal archive syst
47、em and process to manage core CNN News Video Assets. Many groups and news bureaus have their own silos causing duplication and mismanagement of News assets. No process to manage, authenticate, and control assets are they are created, modified, and accessed. Project Objectives Create a centralized st
48、orage repository that provides distributed access to News assets. Build a front-end portal system that : authenticates user access, indexes for search, and provides subscriber service levels to retrieve and publish video News assets. Quantum Solution/Benefits Quantum StorNext File System and Storage Manager. Integrated archive capabilities to a high speed access File System Provides centralized and multi-tier data management Preservation of choice on OS, disk, and tape. CNN has changed all three interfaces in the past 5 years, but all under StorNext control API to tie into custom an