Control of Token Holding in Multi-Token Optical Network

(1)

(12) United States Patent

Raponi et a].

USOO8897643B2

US 8,897,643 B2

Nov. 25, 2014

(10) Patent N0.:

(45) Date of Patent:

(54)

(75)

(73)

(*)

(21)

(22)

(86)

(87)

(65)

(30)

Feb. 25, 2010

(51)

(52)

CONTROL OF TOKEN HOLDING IN MULTI-TOKEN OPTICAL NETWORK

Inventors: Pier Giorgio Raponi, Rovereto (IT);

Nicola Andriolli, Pisa (IT); Piero

Castoldi, Vicopisano (IT); Marzio

Puleri, Fiano Romano (IT) Telefonaktiebolaget L M Ericsson

(publ), Stockholm (SE)

Subject to any disclaimer, the term of this patent is extended or adjusted under 35

U.S.C. 154(b) by 186 days.

13/581,372

Mar. 25, 2010 PCT/EP2010/053950

Assignee:

Notice: Appl. No .: PCT Filed: PCT No.:

§ 371 (00)’

(2), (4) Date: Nov. 13, 2012 PCT Pub. No.: WO2011/103931 PCT Pub. Date: Sep. 1, 2011

Prior Publication Data US 2013/0064544 A1 Mar. 14, 2013

Foreign Application Priority Data

(EP) ... .. 10154671 Int. Cl. H04L 12/819 H041 14/02 H04L 12/721 H04L 12/433 US. Cl. CPC ... .. H04L 47/215 (2013.01); H041 14/0269

(2013.01); H04114/0213 (2013.01); H041

14/0257 (2013.01); H041 14/0205 (2013.01); H04114/0212 (2013.01); H041 14/0221 (2013.01); H041 14/0267 (2013.01); H04L 45/62 (2013.01); H041 14/0275 (2013.01); H04L 12/433 (2013.01); H041 14/0204

(2013.01)

USPC ... .. 398/58; 398/59

(2013.01)

(2006.01)

(2013.01)

(2006.01)

(58) Field of Classi?cation Search

CPC .... .. H04L 12/433; H04L 45/62; H04L 47/215 USPC ... .. 398/58, 59

See application ?le for complete search history.

(56) References Cited

U.S. PATENT DOCUMENTS 7,092,633 B2 8/2006 Fumagalli et al.

2005/0207427 A1 * 9/2005 Su et a1. ... .. 370/400 2008/0124081 A1 * 5/2008 Hamada et a1. ... .. 398/59

FOREIGN PATENT DOCUMENTS

EP 1 578 048 9/2005

OTHER PUBLICATIONS

James Cai,The Multitoken Interarrival Time (MTIT) Access Protocol for Supporting Variable Size Packets Over WDM Ring Network,Oct. 2000,IEEE Journal on Selected Areas in Communications, v01. 18, N0. 10,pp. 2095-2097.*

(Continued)

Primary Examiner * David Payne

Assistant Examiner * Omar S Ismail

(74) Attorney, Agent, or Firm * Baker Botts, LLP

(57)

ABSTRACT

A node (260, 50) for a multi-token optical communications network has optical channels between the node and other

nodes, each channel having a token (T1, T2, T3), passed

between nodes, to indicate that a corresponding optical chan nel is available for transmission during a token holding time. The node has a transmitter (280) for transmitting packets over

the optical channels, a buffer (170, 270) for queuing packets

before transmission, and a transmit controller (170, 290) con ?gured to control the buffer to forward an initial packet or packets from the buffer to the transmitter once a token has been received. The transmit controller determines how much of the token holding time remains after the transmission of the initial packet or packets, and then controls the buffer to for ward a further packet according to the remaining token hold ing time. A maximum packet delay can be reduced where there is asymmetric tra?ic. A token holding time can be different for different nodes.

17 Claims, 21 Drawing Sheets

Control lapér channel 170 Queue management Tm. witc 180

table

X

190 (

controllerloal

(2)

US 8,897,643 B2

Page 2

(56) References Cited

OTHER PUBLICATIONS

GhiZZi, M., et al., “On the Performance of a WDM Ring Network with Multitoken Interarrival Time (MTIT) MAC Protocol,” Proc.

Noc 2004, Jun. 2004.

International Search Report for PCT/EP2010/053950, mailed Nov. 10, 2010.

Cai, J et al., “The Multitoken Interarrival Time (MTIT) Access Pro tocol for Supporting Variable Size Packets Over WDM Ring Net work”, IEEE Journal on Selected Areas in Communications, vol. 18, No. 10, (Oct. 1, 2000), pp. 2094-2104.

Peng, L-M et al., Design and performance comparison of multiple token based MAC protocols for optical burst switched ring networks, Photonic Network Communications, vol. 15, No. 3, (Nov. 13, 2007),

pp. 213-225.

(3)

US. Patent

Nov. 25, 2014

Sheet 1 0f 21

US 8,897,643 B2

FIG 1

I ________________ __

II OTHER NODES OF THE l

| OPTICAL NETWORK

{

l 250

:

L___A__ _ _ _ _ _ _ _ __1_‘_.

OPTICAL

CHANNELS

TOKENS

NODE

260 TRANSMITTER

TX

280

‘ PACKETS

TRANSMIT

FOR

TRANSMISSION

290

270 PACKET

FORWARDING

CONTROL

PACKETS

FOR

TRANSMISSION

(4)

US. Patent

Nov. 25, 2014

Sheet 2 0f 21

US 8,897,643 B2

FIG 2

RECEIVE TOKEN FROM

ANOTHER

NODE 300

DETERMINE WHETHER

A

TOKEN HOLDING

TIME IS SUFFICIENT TO ALLOW

A

PACKET TO

BE TRANSMITTED

310 YES

NO

CONTROL BUFFER TO FORWARD

ONE OR

MORE PACKETS TO TX

FOR TRANSMISSION OVER

CORRESPONDING CHANNEL

320 DETERMINE

RELEASE TOKEN

REMAINING

TO ANOTHER

TOKEN HOLDING

NODE

TIME AFTER

340 PACKET

TRANSMITTED

330

(5)

US. Patent

Nov. 25, 2014

Sheet 3 or 21

_{US 8,897,643 B2}

FIG 3

RECEIVE TOKEN FROM

ANOTHER

NODE 300

DETERMINE WHETHER

A

TOKEN HOLDING

TIME IS SUFFICIENT TO ALLOW

A

PACKET TO

BE TRANSMITTED

310 YES

NO

CONTROL BUFFER TO FORWARD ONE OR

MORE

PACKETS TO TX FOR

TRANSMISSION OVER CORRESPONDING

OPTICAL CHANNEL

320

‘

IF FURTHER TOKEN RECEIVED,

DETERMINE WHETHER

FURTHER TOKEN

HOLDING TIME IS SUFFICIENT

325

7 YES NO

CONTROL BUFFER TO

FORWARD ONE OR

MORE

OTHER

PACKETS TO TX

FOR

TRANSMISSION OVER OTHER

OPTICAL CHANNEL

SIMULTANEOUSLY

335

Y ‘7

DETERMINE

RELEASE

REMAINING

OTHER

TOKEN TO

TOKEN HOLDING

TOKEN To

ANOTHER

TIME AND

ANOTHER

NODE

REMAINING

NODE 345

340 FURTHER TOKEN

HOLDING TIME

i

(6)

US. Patent

Nov. 25, 2014

Sheet 4 0f 21

US 8,897,643 B2

FIG 4

l

RECEIVE TOKEN FROM

ANOTHER

NODE 300

‘I

DETERMINE TARGET INTER ARRIVAL TIME

410 I

DETERMINE ACTUAL INTER ARRIVAL TIME BACK

TO ARRIVAL TIME OF PRECEDING TOKEN

420 DETERMINE TOKEN HOLDING TIME FROM

TARGET

AND

ACTUAL INTER ARRIVAL TIMES

430 DETERMINE IF TOKEN HOLDING TIME IS

SUFFICIENT TO SEND A

PACKET

440 NO—l

YES

IF SO, FORWARD A

PACKET FROM THE QUEUE TO

THE TRANSMITTER FOR

THE RESPECTIVE

CHANNEL

450 DETERMINE WHEN

PACKET TRANSMISSION IS

COMPLETE AND OPTIONALLY RELEASE TOKEN TO

NEXT NODE EVEN IF THERE IS MORE HOLDING

TIME AVAILABLE

460 RELEASE TOKEN TO ANOTHER

NODE

340

(7)

US 8,897,643 B2

Sheet 5 0f 21

NOV. 25, 2014

US. Patent

m

@E

§\\\\\\\\\\\\\\\\\\\\\\\\

Wm“

H

Si

\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\_.

EFéE

" we; 2.66:

/

(8)

(9)

US. Patent

Nov. 25, 2014

Sheet 7 0f 21

US 8,897,643 B2

FIG 7

\

BUFFER 270

TOKEN

HELD AT

)

NODE

PACKET FORWARDED

TO LASER INPUT FOR

7 OPTICAL CHANNEL

/’//

CORRESPONDING TO

// 4

TOKEN

DATA

INPUT

PATHS FOR

EACH LASER OF

TRANSMITTER

% 20

30 7H

M

(10)

U.S_ Patent

FIG 8

Nov. 25, 2014

Sheet 8 0f 21

_{Us 8’89'79643 B2}

(11)

US. Patent

FIG 9

NOV. 25, 2014

Sheet 9 0f 21

TTIT table

0.9 TTIT

TTIT

2-TTIT

US 8,897,643 B2

(12)

US. Patent

Nov. 25, 2014

Sheet 10 0f 21

US 8,897,643 B2

Fig 10

100 Control

channe|‘\

_{170 Queue}

management

Cross-pomt

witch 180

controllerZOO

Tributaries 210

(13)

US. Patent

Nov. 25, 2014

Sheet 11 0121

US 8,897,643 B2

FIG 11

RECEIVE TOKEN FROM

ANOTHER

NODE 300

DETERMINE WHETHER

A

TOKEN HOLDING

TIME IS SUFFICIENT TO ALLOW

A

PACKET TO

BE TRANSMITTED

310 YES

NO

SELECT ONE OR

MORE

PACKETS

IN BUFFER

BASED ON

PACKET

CHARACTERISTICS SUCH AS

SIZE, PRIORITY

319 CONTROL BUFFER TO

FORWARD ONE OR

MORE

PACKETS TO TRANSMITTER

FOR TRANSMISSION

320 ESTIMATE TRANSMISSION

DURATION OF

FORWARDED PACKET OR

PACKETS

333 '

RELEASE TOKEN

DETERMINE

TO ANOTHER

REMAINING

NODE

TOKEN HOLDING

340 TIME AFTER

PACKET

TRANSMITTED

330

(14)

US. Patent

Queuing data}; {ms}

NOV. 25, 2014

Sheet 12 0f 21

_{US 8,897,643 B2}

H

18“

mad 90% i

Nada ‘0

» Wu?

6 per pki

‘ 1 W532 per pk?

W=16 ciassic

J W232: {3133510

FIG 12

1 d2

Quauing deiay {ms}

1 0“

19 as“

m"

WS1 8 per pk?

Lead : 90%

~

-' W=32 per pm

Nada 6

FIG 13

‘ W316 classic “

= W332 classic

1 a“

19$

(15)

US. Patent

Nov. 25, 2014

Sheet 13 0f 21

US 8,897,643 B2

77777 ‘ ...C.LASSI.C l .... .._

IMPLEMENIAIIQM

LL l 7777777777 "

D

n_ _____ _.

O

2

4

6

8

10 FIG 14

Queuing delay [ms]

Load = 90%, W

= 16, client node

l l l u. """""""""""""""""""""""""""""""""" ___________________________ " Q ... ... -._ D- ... ... -._ l l

0

2

4

6

8

10 Queuing delay [ms]

FIG 15

CLIENT

CLASSIC

IMPLEMENTATION

(16)

US. Patent

Nov. 25, 2014

Sheet 14 0f 21

US 8,897,643 B2

mm

Hub mm FIG 16

. . . 1 . . . . . . . . . . . . . . . . . . _ _ . . . . . . _ _ _ _ _ _ _ . . . . ..

M

NO

TTIZTIDIFIFERENTIATIQN.

.M

I I 7777777777777 W

FIG 17

... PER-PACKET IMPLEMENTATION .. I I I - I I

OTTIT DIFFERENTIATION

{E

I

ii

5 ?iaiay Ems];

(17)

US. Patent

Nov. 25, 2014

Sheet 15 0f 21

US 8,897,643 B2

1“ v. _ .PERQPACKETYIMPLEMENTATIQN _ A“ 1 w HTTIT DIFFERENTIATlQNOFTWQ H M WAVELENGTHS‘ ,

FIG 19

mm“

W “15%

twmkm

1:: """""" " pLIELfN' 1 """"""""""""" "g g i

PER-PACKET IMPLEMENTATION

‘

TIT'DIFFERENTIATI'ON'OTWO“ " " " "“

S

2 E

ii;

5:;

(18)

US. Patent

Nov. 25, 2014

Sheet 16 0f 21

US 8,897,643 B2

Load 96%, W

= 325 Hub node

¥

5 I

I

PDF

U

2'

4

5

3 1B

Queuing delay [ms]

SERVER

CLASSIC IMPLEMENTATION

FIG 20

Load 2 90%, W

== 32, alient node

=!

s

E

I

'

ICLASSICS'IMPLEMENTATiQNIfi'fjfi]IQ]

(19)

US. Patent

Nov. 25, 2014

Sheet 17 0f 21

US 8,897,643 B2

Load = 90%, W

= 32, Hub node, Per-packet

I I l

SERVEER

5 PER=BAGI<EIIMPLEM-ENTATIQN

--- --

NO TTIT DIFFERENTIATION D _ ... ... -._

EL

2

0 0 .5

1 1 .5

2 Queuing delay [ms]

FIG 22

FIG 23

Load = 90%, W

= 32, client node, Per-packet

' CLIENT !

1

1 !

"PERZPACKET'IMPHEMENTATION --- --- " __0..T§TIT.I)IEEEREI$ITIATIQI\I _____ __________ ... .__

PDF

1

0 0511.5 2

2.5

3

3.5

4 Queuing delay [ms]

(20)

US. Patent

Nov. 25, 2014

Sheet 18 0f 21

US 8,897,643 B2

FIG 24

Load = 90%, W

= 32, Hub node, Tweaked

I l l .... SERVER ' """ " 'ERJPAYCKETIMPLEMENTATTON'"1 """""""""" " _':=:= II1.T..D_I;EEERENI1AI.IJQN.QN.IW.Q_.j ... _._

WAVELENGTHS

5

LL _ . --- --- --- --= --- _-_

D

E

Q_ - _______________________________________ ___________________________________________ ___ I l

0

0.5

1

1.5

2 Queuing delay [ms]

FIG 25

Load = 90%, W

= 32, client node, Tweaked

I CLIEII‘TT I I I l l

; PER-BACKET IMPLEMENTATION;

I

-i -TYPE-DIFFERENTIATIGN-ni ---

--- --- --

ON TWO WAfVELEN5GTHS g

g

u.

D ______________________________________________________________ ___

n.

i

0 0.5115 2

2.5

3

3.5

4 Queuing delay [ms]

(21)

(22)

(23)

(24)

(25)

(26)

(27)

(28)

(29)

(30)