GA»Æ½ð¼×

¡°¼«¼ò¡±»ÀР¡¤ È«ÓòÖÇÁª Ø­ GA»Æ½ð¼×м«¼òÁ캽ÏÂÒ»´úÐ£Ô°Íø½¨Éè×êÑлá
date
Ô¤Ô¼Ö±²¥
ÎÞ¸Ð×¼Èë ÈËÎïͳ¹Ü Ø­ RG-SAM+5.X ÐÂÒ»´ú¸ßУAIÈÏ֤ƽ̨°ä²¼
date
Ô¤Ô¼Ö±²¥
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
²úÆ·
< ·µ»ØÖ÷²Ëµ¥
²úÆ·ÖÐÐÄ
²úÆ·
½â¾ö¹æ»®
< ·µ»ØÖ÷²Ëµ¥
½â¾ö¹æ»®ÖÐÐÄ
ÐÐÒµ
ºÏ×÷ͬ°é
·µ»ØÖ÷²Ëµ¥
Ñ¡ÔñÇøÓò/˵»°
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾ GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

ÈôºÎͨ¹ýÍøÂçÒ£²â£¨Network Telemetry£©¼¼ÊõʵÏÖ¾«ÃÜ»¯ÍøÂçÔËά£¿

¡¾ÍøÂçÔËά¡¿±¾ÎĽ«Í¨¹ý½éÉÜ»ùÓÚ»¥»»»úÓ²¼þоƬµÄÍøÂçÒ£²â£¨Network Telemetry£©¼¼Êõ¹æ»®£¨INT+gRPC£©  £¬ÊµÏÖÕûÍøµÄÁ÷Á¿¿ÉÊÓ»¯  £¬ÎªÊµÏÖÕæÕýµÄ¿ÉÊÓ»¯ÔËάÌṩеÄ˼·¡£

  • GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

    °ä²¼¹¦·ò£º2018-04-03

  • GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

    µã»÷Á¿£º

  • GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

    µãÔÞ£º

·ÖÏíÖÁ

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

ÎÒÏëÆÀÂÛ

»ùÓÚAI¡¢´óÊý¾ÝµÄ»¥ÁªÍøÀûÓÃÍÆ¶¯ÁË»¥ÁªÍøÊý¾ÝÖÐÐIJúÆ·¡¢¼¼ÊõµÄ¼±¾çÉý¼¶¡£

Ê×ÏÈ  £¬½ÓÈë´ø¿í´Ó´«Í³µÄ10GbpsÉý¼¶µ½25Gbps/100Gbps  £¬±ØÒª»ù´¡ÍøÂçÌṩ¸ßת·¢ÄÜÁ¦±£ÏÕÒµÎñµÄ¸ß¿ÉÓá£

Æä´Î  £¬»ùÓÚRDMA£¨Remote Direct Memory Access  £¬Ô¶³ÌÖ±½ÓÄÚ´æ½Ó¼û£©ÎÞËðÒÔÌ«Íø¼¼ÊõµÄÆÕ±éÀûÓà  £¬ÊµÏÖÁËÍÆËã½Úµãµ½´æ´¢½ÚµãµÄ΢Ãë¼¶ÑÓʱ  £¬´ó´óÓÅ»¯¶Ëµ½¶ËµÄÒµÎñת·¢»úÄÜ  £¬¶øÕâÒ²Òâζ×ŶÔÍøÂçÔËάÌá³öÁ˸ü¸ßµÄÌôÕ½——ÈôºÎÔÚ´ó¹æÄ£¡¢¸´ÔÓµÄHPC(High Performance Computing)ÍøÂçÖÐʵÏÖÔ½·¢¾«ÃܵÄÁ÷Á¿¿ÉÊÓ¡¢¿É¿Ø£¿ÈôºÎÃæÏòÒµÇóʵÏֶ˵½¶ËµÄÃë¼¶¹ÊÕ϶¨Î»  £¬²¢ÎªÍøÂçµÄ³ÖÐøÓÅ»¯Ìṩ¾«×¼µÄÊý¾ÝÖ§³Ö£¿

±¾ÎĽ«Í¨¹ý½éÉÜ»ùÓÚ»¥»»»úÓ²¼þоƬµÄNetwork Telemetry¼¼Êõ¹æ»®£¨INT+gRPC£©  £¬ÊµÏÖÕûÍøµÄÁ÷Á¿¿ÉÊÓ»¯  £¬ÎªÊµÏÖÕæÕýµÄ¿ÉÊÓ»¯ÔËάÌṩеÄ˼·¡£

 

ÍøÂçÔËάÐÂÌôÕ½

ΪÁËÈ·±£ÒµÎñµÄ¸ß¿¿µÃס  £¬»ùÓÚScale out·½Ê½ÊµÏÖµÄÉ¢²¼Ê½ÍÆËãºÍ´æ´¢ÀûÓã¨Hadoop/ Map reduce/HDFS£©µÃµ½ÁË´ó¹æÄ£Ê¹Óà  £¬²»½öÍѽÚÁ˵¥·þÎñÆ÷µÄÍÆËã¡¢´æ´¢»úÄܵÄÏÞ¶È  £¬Í¬Ê±¿ÉÌṩ¸ü½Ã½ÝµÄÀ©´óÐÔ  £¬¿ÉÄܼ±¾çÏìÓ¦ÒµÎñÐèÒª±ä¶¯  £¬Ìá¸ßϵͳµÄ¿¿µÃסÐÔ¡¢¿ÉÓÃÐԺʹæÈ¡Ð§ÄÜ¡£

È»¶øÒµÎñ×ÔÉíÔÚÍøÂçÆ½É¢²¼ÊDz»³É¿ØµÄ  £¬Òò¶øÔÚÏÖÊµÍøÂçÁ÷Á¿Ä£ÐÍÖв»³ÉÔ¤·À»á³öÏÖ¶à¶ÔÒ»µÄͨѶģʽ  £¬¼´ IncastÄ£ÐÍ¡£ÏÂͼ¼´µäÐ͵ÄIncastͨѶģÐÍ£º

 

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

¡ø TCP IncastͨѶģÐÍʾÒâͼ

 

ÀýÈç  £¬µ±Ò»Ì¨Master½ÚµãÏòÒ»×éSlave½ÚµãÌáÒéÒ»¸öÍÆË㹤×÷ÒªÇóʱ  £¬ËùÓÐSlave½ÚµãÏÕЩ»áͬʱ·µ»ØÍÆËãÁ˾ÖÊý¾Ý  £¬¶ÔÓÚMaster½ÚµãÀ´Ëµ¾Í²úÉúÁËÒ»¸ö“΢ͻ·¢Á÷”¡£¶ÔÓÚºÏÀíµÄ“΢ͻ·¢Á÷”  £¬Äܹ»ÒÀ¸½½ÓÈ뻥»»»úÉ豸ÄÚ²¿µÄ±¨ÎÄ»º´æ»úÔì½â¾ö΢ͻ·¢¶ª°üÎÊÌâ¡£

Ŀǰ  £¬Ö÷Á÷»¥»»Ð¾Æ¬µÄƬÉÏ»º´æ±ÈÁ¦Ó×  £¬Í¨³£ÒÔMbyteΪµ¥Ôª¡£ÏÂͼÊǶÔÓ¦1G¡¢10GºÍ25G»¥»»»ú³£ÓÃоƬµÄ»º´æÈÝÁ¿¡£

 

½Ó¿Ú¿ìÂÊ

»º´æÈÝÁ¿

1000Mbps

4MB

10Gbps

16MB

25Gbps

32MB

¡ø ´ø¿íÌáÉýÓ뻺´æÌáÉý¶Ô±È×¢Ã÷

 

´Ó±íÖв»ÄÑ¿´³ö  £¬ÍøÂç½Ó¿Ú¿ìÂÊ´Ó1Gbps·¢Õ¹µ½25Gbps  £¬·þÎñÆ÷µÄÍÌÍÂÄÜÁ¦Ôö³¤25±¶  £¬¶ø»¥»»»úоƬµÄ»º´æÈÝÁ¿Í¬±È½öÔö³¤8±¶  £¬Í¬Ê±¿ÉÓûº´æ¹¦·ò·´¶ø½µÂä65%£¨ÒÀÕÕ»¥»»»úÈ«¶Ë¿ÚƽÕýʹÓûº´æÎªÀý£©¡£

Òò¶ø  £¬25GÍøÂç¼Ü¹¹µÄTCP Incast¾°Ïó±È10GÍøÂçÔ½·¢ÏÔÖø  £¬Ë²Ê±µÄ¶à´òÒ»µ¼Ö³ö½Ó¿Ú±¨ÎÄÓµÈû  £¬³ö½Ó¿Ú»º´æÓÃÍêºó»á»ùÓÚβ²¿Åׯú»úÔì½øÐжª°ü  £¬ÀûÓüà²âµ½¶ª°üºóÌáÒéTCP³Á´«  £¬Ôì³ÉÊý¾Ý¶Ëµ½¶ËÑÓʱµÄ½øÒ»²½¶ñ»¯  £¬ÑϳÁÓ°ÏìÒµÎñÂÄÀú¡£

Õë¶ÔÍøÂ綪°üÒýÆðµÄÒµÎñ¹ÊÕÏ  £¬±ØÒªÍøÂç¼à¿ØÏµÍ³¼±¾ç¶¨Î»ÍøÂçÖÐÄĄ̈»¥»»»úµÄÄĸö¶Ë¿ÚÒò»º´æ²»¼°µ¼ÖÂÁ˶ª°ü¡£Í¬Ê±  £¬³ÁÒªÒµÎñ¶Ëµ½¶ËʱÑÓ³¬³öÔ¤ÆÚʱ  £¬Ò²±ØÒª¶¨Î»Á÷Á¿×ª·¢õè¾¶ÉÏÿ¸ö½ÚµãµÄת·¢Ê±ÑÓ¡£

×ܽáÆðÀ´  £¬±ØÒªÍøÂç¼à¿ØÏµÍ³ÊµÏÖÈçÏÂÄÜÁ¦£º

¡ñ¼±¾ç¶¨Î»ÄĄ̈»¥»»»úµÄÄĸö¶Ë¿Ú²úÉú¶ª°ü£»

¡ñʵʱ¼à¿ØÃ¿Ì¨»¥»»»úµÄBufferʹÓÃÇé¿ö£»

¡ñ¶Ëµ½¶ËʱÑÓÄܹ»¶¨Î»µ½¾ßÌåÉ豸ºÍÁ´Â·¡£

 

ÔËά¿ÉÊÓ»¯¼¼ÊõʵÏÖ

ƾ½è´«Í³µÄÍøÂç¼à¿Ø¼¿Á©ÎÞ·¨½â¾ö“¿´²»¼û”µÄÎÊÌâ  £¬ÈçʱÑÓ¡¢×ª·¢õè¾¶¡¢»º´æºÍ¶ª°ü¡£ÀýÈç  £¬ÓÉ±í²¿ÀûÓÃÌáÒéµÄÒªÇó»ñÈ¡ÍøÂç״̬ÐÅÏ¢µÄSNMPºÍ̸  £¬¾ÍÎÞ·¨ÊµÊ±·´Ó³ÍøÂçµÄ״̬¡£

ΪÏàʶ¾ö´ËÀàÄÑÌâ  £¬Òµ½ç¿í·ºÒýÈëNetwork Telemetry£¨ÍøÂçÒ£²â£©ÕâÒ»ÀíÏë  £¬Ïà±Å×ÚSNMP  £¬TelemetryʵÏÖÁËÍøÂçÉ豸×Ô¶¯ÍÆËÍ״̬ÐÅÏ¢µÄÄÜÁ¦  £¬ÓµÓиüÇ¿µÄʱЧÐÔ¡£

ÊÂʵÉÏ  £¬Telemetry²¢²»ÊÇз¢ÏÖ  £¬NetFlowºÍsFlowÔçÒÑʵÏÖÁËÍøÂçÁ÷Á¿µÄ²ÉÑùºÍÍÆËÍ  £¬µ«NetFlow¡¢sFlowÍÆË͵ÄÊÇԭʼµÄÊý¾Ý²ÉÑùÐÅÏ¢  £¬Êý¾ÝÒÔIP±¨ÎÄÌåʽ³öÏÖ¸ø·ÖÎö¹¤¾ß  £¬¶ø·ÇÓû§½øÕ¹µÄ¹æ·¶»¯Êý¾ÝÄ£ÐÍ  £¬ÔÙÓÅÒìµÄ·ÖÎö¹¤¾ßÆäÀ©´ó»úÄÜÒ²ÄÑÒԳе£Õû¸öÊý¾ÝÖÐÐÄÍøÂçµÄ¼à¿Ø·ÖÎö  £¬Ö»ÄÜÔÚijһ·ÖÎö¹¤×÷ÖвûÑï×÷Óá£

ÁíÒ»·½Ãæ  £¬Êý¾ÝÁ÷Á¿²¢·ÇÍøÂç״̬µÄÈ«Êý  £¬ÍøÂçÉ豸µÄ CPU¡¢ÄÚ´æ¡¢ÍøÂçÓµÈûÐÅÏ¢¡¢ÍøÂçÊÂÎñµÄÈÕÖ¾ÐÅÏ¢µÈÒ²ÎÞ·¨Í¨¹ýNetFlow»òÕßsFlowʵʱ´«µÝ³öÀ´¡£

 

gRPC£¨Google Remote Procedure Calls   £¬¹È¸èÔ¶³Ì¹ý³ÌŲÓã©ÊÇGoogle¹«Ë¾¿ªÔ´µÄÒ»¸ö¸ß»úÄÜ¡¢¿ç˵»°µÄRPC¿ò¼Ü  £¬Ê¹ÓÃHTTP/2ºÍ̸²¢Ê¹ÓÃProto Buffer×÷ΪÐòÁл¯ºÍ·´ÐòÁл¯µÄ¹¤¾ß¡£Í¨¹ýÔÚ»¥»»»úÖм¯³ÉgRPCÀûÓà  £¬½ç˵½Ã½ÝµÄÊý¾ÝÌåʽÒÔ¼°Êý¾ÝÍÆË͵ÄãÐÖ·´ÊµÏÖ»¥»»»ú×ÔÉí״̬µÄ×Ô¶¯ÍÆËÍÄÜÁ¦  £¬Äܹ»ÊµÏÖÖÜÆÚÐÔÍÆËÍ»¥»»»úBuffer Usage¡¢CPU¡¢MemoryµÈÐÅÏ¢¸ø¼à¿Ø·þÎñÆ÷¡£µ±²úÉúBuffer²»¼°µ¼Ö¶ª°ü  £¬Ò²»áʵʱ֪ͨ¸ø¼à¿Ø·þÎñÆ÷  £¬ÊµÏÖÍøÂçÔËÐÐÊý¾ÝµÄ¿ÉÊÓ»¯¡£

 

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

¡ø gRPC½»»¥»úÔì

 

ÉÏͼչʾÁËÆäÖÐÒ»ÖÖgRPCµÄ½»»¥»úÔ죺

¡ñÔÚ»¥»»»ú¿ªÆôgRPCÖ°Äܺó³äÈÎgRPC ¿Í»§¶Ë½ÇÉ«  £¬¼à¿Ø·þÎñÆ÷³äÈÎgRPC·þÎñÆ÷½ÇÉ«£»

¡ñ»¥»»»ú×Ô¶¯Ïò¼à¿Ø·þÎñÆ÷ÌáÒégRPCͨ·½¨Á¬£»

¡ñ»¥»»»ú×Ô¶¯Éϱ¨Buffer Usage¡¢CPU¡¢ÄÚ´æµÈÐÅÏ¢¸ø¼à¿Ø·þÎñÆ÷  £¬µ±Buffer²úÉú¶ª°ü  £¬»¥»»»úÓöÒ²»áʵʱÉϱ¨¶ª°üÊÂÎñ¸ø¼à¿Ø·þÎñÆ÷¡£

gRPCµÄ³öÏֺܺõĽâ¾öÁËʵʱÊý¾ÝÎÞ·¨ÓÐЧ´«¸ø¼à¿Ø·þÎñÆ÷µÄÎÊÌâ¡£

INT£¨In-band Network Telemetry£©Ò²ÊÇÒ»ÖÖÐÂÐÍTelemetryºÍ̸  £¬ÓÉBarefoot¡¢Arista¡¢Dell¡¢IntelºÍVMware¹²Í¬Ìá³ö¡£INTµÄ³öÏÖ½â¾öÁËת·¢õè¾¶ºÍת·¢Ê±ÑÓ²»Ë½¼ûµÄÎÊÌâ¡£

INTµÄÕûÌå´¦ÖÃÁ÷³ÌÈçÏÂͼËùʾ£º

 

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

¡ø  ¿ÉÊÓ»¯ÍøÂç

 

¡ñ±¨ÎÄ´ïµ½Ê×½Úµã  £¬Í¨¹ýÔÚ»¥»»»úÉÏÉèÖõIJÉÑù·½Ê½Æ¥Åä²¢¾µÏñ³ö¸Ã±¨ÎÄ  £¬²¢ÔÚËIJãÍ·²¿ºó²åÈëINTÍ·  £¬½«±¨ÎÄÈë¶Ë¿ÚPort ID¡¢³ö¶Ë¿Ú Port ID¡¢Èë¶Ë¿Ú¹¦·ò¡¢³ö¶Ë¿Ú¹¦·ò¡¢ÒÔ¼°É豸µÄDEVICE ID·â×°³ÉMetaData  £¬½«MD²åÈëµ½INTÍ·²¿Ö®ºó£»

¡ñ±¨ÎÄת·¢µ½ÖÐÑë½Úµã  £¬É豸ƥÅäµ½INTÍ·²¿ºó  £¬ÔÚINTÍ·²¿ºóÔÙ²åÈëÒ»²ãMD£»

¡ñ±¨ÎÄת·¢µ½×îºóÒ»Ìø  £¬É豸ƥÅäINTÍ·²¿ºó  £¬ÔÙ²åÈëÒ»²ãMD  £¬²¢ÔÚ±¨ÎÄ±í²¿·â×°Ò»¸öIPÍ·£¨ERSPAN£©  £¬±í²ãIPΪ¼à¿Ø·þÎñÆ÷µØÖ·  £¬ÕâÑùINT±¨Îıãת·¢µ½¼à¿Ø·þÎñÆ÷¡£

×ܽ᣺Õë¶ÔÃæÏòHPCÒµÎñµÄÏÂÒ»´úÊý¾ÝÖÐÐÄÍøÂç  £¬»ùÓÚINTºÍgRPCµÄNetwork Telemetry¼¼ÊõÄܹ»ÊµÏÖÒµÎñ¶Ëµ½¶ËµÄÍøÂçÁ÷Á¿¿ÉÊÓ»¯  £¬Í»ÆÆ“ÍøÂçºÚºÐ”  £¬Îª¾«ÃÜ»¯ÍøÂçÔËάÌṩÕûÌåµÄ½â¾ö¹æ»®ºÍ±ØÒªµÄ¼¼ÊõÖ§³Ö¡£

GA»Æ½ð¼×ÍøÂçÐÂÒ»´ú25G/100GÍøÂ绥»»»ú²úÆ·¾ùÒÑʵÏÖNetwork TelemetryÄÜÁ¦£¨gRPCºÍINT£©  £¬ÈôÊÇÄú¶ÔÍøÂçÒ£²â¸ÐÐËÖ  £¬Ó­½ÓÁôÑÔ»¥»»¡£

 

±¾ÎÄ×÷Õߣº³Â¶¬ÁÖ

GA»Æ½ð¼×ÍøÂ绥ÁªÍøÏµÍ³²¿ÐÐÒµÕ÷ѯ

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

 

ÍùÆÚ½Ü³ö»ØÊ×

¡¾µÚÒ»ÆÚ¡¿Ç³Ì¸ÎïÁªÍø¼¼Êõ֮ͨѶºÍ̸µÄ·×Õù

 

ÓйØÍƼö£º

• ÏàʶgRPC¼¼Êõ  £¬Õâһƪ¾Í¹»ÁË

¸ü¶à¼¼Êõ²©ÎÄ

ÈκαØÒª  £¬ÇëÁªÏµGA»Æ½ð¼×

GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾

·µ»Ø¶¥²¿

ÊÕÆð
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾ ÎĵµAI¸±ÊÖ
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾ ÎĵµÆÀ¼Û
ev-close
¸Ã×ÊÁÏÊÇ·ñ½â¾öÁËÄúµÄÎÊÌ⣿
ev-close
Äú¶Ôµ±Ç°Ò³ÃæµÄÖÐÒâ¶ÈÈôºÎ£¿
²»Õ¦µÎ
¼«¶ÈºÃ
dark-star dark-star dark-star dark-star dark-star
ev-close
ÄúÖÐÒâµÄÔ­ÒòÊÇ£¨¶àÑ¡£©£¿
ev-close
Äú²»ÖÐÒâµÄÔ­ÒòÊÇ£¨¶àÑ¡£©£¿
ev-close
ÄúÊÇ·ñ»¹ÓÐÆäËûÎÊÌâ»ò½¨Ò飿
ΪÁ˼±¾ç½â¾ö²¢»Ø¸´ÄúµÄÎÊÌâ  £¬ÄúÄܹ»ÁôÏÂÁªÏµ·½Ê½
ÓÊÏä
ÊÖ»úºÅ
ev-bg
¸Ð¼¤ÄúµÄ·´À¡£¡
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
GA»Æ½ð¼×¡¤(Öйú¼¯ÍÅ)¹Ù·½ÍøÕ¾
ÇëÑ¡Ôñ·þÎñÏîÄ¿
¹Ø¹ØÕ÷ѯҳ
ÊÛǰÕ÷ѯ ÊÛǰÕ÷ѯ
ÊÛǰÕ÷ѯ
ÊÛºó·þÎñ ÊÛºó·þÎñ
ÊÛºó·þÎñ
¶¨¼û·´À¡ ¶¨¼û·´À¡
¶¨¼û·´À¡
¸ü¶àÁªÏµ·½Ê½
¡¾ÍøÕ¾µØÍ¼¡¿