RFC0088: NETRJS: A third level protocol for Remote Job Entry
Download in PDF format Download in text format
Obsoleted By:
RFC0189
Network Working Group R. Braden Request for Comments: 88 S. Wolfe NIC: 5668 UCLA/CCN 13 January 1971 NETRJS - A THIRD LEVEL PROTOCOL FOR REMOTE JOB ENTRY A. Introduction NETRJS is the name for a message protocol and set of control conventions which will allow users at remote Hosts to access the RJS ("Remote Job Service") remote batch subsystem of CCN. RJS[1] was written at CCN to support remote batch (car reader/line printer) terminals over communications lines. RJS makes a remote batch terminal's unit record devices operate as if they were at the central site; thus, a remote user enters OS/360 jobs, complete with JCL, into the remote reader. The jobs are spooled into the operating system and run in their turn, and the printed and/or punched output is returned to the remote terminal from which the jobs originated (unless the user or operator re-routes the output). The remote terminal may also include a console typewriter to be used by the remote operator to receive and send messages and to exert control over his terminal [2]. When RJS is used via the ARPA Network, the "remote terminal" is expected to be a multiprogrammed user process in a remote Host. We will use the RJS term "remote site" for such a user process, which presumably simulates unit record devices by file I/O. Furthermore, several users at the same remote Host may simultaneously use NETRJS, acting as independent "remote sites" distinguished by 8-character names called _terminal-ids_ (because each remote site appears to RJS as a separate physical terminal). Valid terminal-ids will be assigned to individual users or user groups at remote Hosts who wish to use NETRJS. Under NETRJS, a separate ARPA network connection is opened from this remote site to CCN for each (simulated) unit record device. Each such connection will be called a _channel_ and be designated _input_ or _output_ with reference to CCN. We define a _standard_ remote site in NETRJS to have the following five channels (See Figure 1): 1._Operator Input Channel_ - Commands and messages entered by remote "operator" console. 2 _Operator Output Channel_ - Message stream which would normally be directed to remote operator. Braden, et. al. [Page 1] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 3._Input Stream_ - One simulated Hollerith card reader for job submission. 4._Printer Stream_ - One simulated line printer to record printed output (system messages and SYSOUT data sets) from jobs. 5._Punch Stream_ - One simulated card punch, capable of recording arbitrary (i.e., transparent) binary text. RJS actually will support more than one reader, printer, and punch at each remote terminal, so the NETRJS protocol could easily be expanded to allow multiple simultaneous I/O streams to each Network user. However, this does not presently appear useful, as the ARPA Network bandwidth will normally be the limitation on the transmission speed under NETRJS. Under NETRJS, the text of a single network message is called a _block_. A block is of variable length, up to 900 bytes (except operator input and output blocks, which may not exceed 130 bytes). Here the term _byte_ refers to the set of 8 bits representing one character; each byte is to be aligned on an 8-bit boundary within the message (and block). Thus we may consider a block to be a string of bytes. The detailed format of a block will be defined in Sections E, F, and G, using essentially the formalism suggested by Bobrow and Sutherland in RFC #31. Since the central site Host (CCN) is an IBM 360, NETRJS uses the IBM EBCDIC character code to avoid redundant code conversion at both hosts in those cases when the remote host also uses EBCDIC internally. However, the message formats make no assumption about the code, and in fact, "object decks" sent to the (simulated) card punch will normally contain arbitrary binary text. To maximize the use of the available Network bandwidth, we strongly recommend transmitting input blocks as large as possible; CCN will always fully block NETRJS output. Furthermore, to avoid excessive overhead, we urge that all NETRJS users make their marking _a multiple of 8 bits_, so the messages received at CCN arrive on a byte boundary. B. Starting a Session[3] The initial connection protocol for NETRJS is essentially that of Crocker in RFC #66 (as restated by Harslem and Heafner in RFC #80), with some extensions. User U at a remote Host presumably requests his outgoing logger to make a NETRJS connection to CCN. This Braden, et. al. [Page 2] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 logger does so by first sending an initial RFC to connect socket (user,aen) = (U,s) to CCN socket (0,5). User 0 at CCN is the incoming logger, and aen = 5 signifies NETRJS. The CCN incoming logger will allocate a set of (six) consecutive aen numbers A, A+1,......A+5, for user U, return a message containing the socket number (U,A) as specified in RFC #66, and close the initial connection. The remote and central sites will then open an input channel between CCN socket (U,A) (socket f in Figure 1) and remote socket (U, s+1). This is the remote operator input channel. The other devices have fixed aen's at CCN assigned relative to A, in particular: CCN Socket Channel (User,aen) Operator Input (U,A) Operator Output (U,A+1) Card Reader (No. 1) (U,A+2) Printer (No. 1) (U,A+3) Punch (No. 1) (U,A+5) Once the operator input channel is open, the remote site must transmit a valid RJS signon message [2]. This message is free-format and consists of the command verb "SIGNON" followed by the user's terminal-id. If RJS does not recognize the terminal-id or has no available Line Handler for the Network, it will indicate refusal by closing the operator input channel. Central site issues subsequent RFC's for the other channels listed above only in response to corresponding RFC's from the remote site To terminate the session, the remote site may close the console input channel (socket "a" in figure 1). Alternatively, the user can enter a SIGNOFF command through the operator input channel; in this case, RJS will wait until the current job output streams are complete and then terminate the session. RJS terminates the session by closing the console output channel (socket g). Also, if RJS should abend then socket g will close. If either site terminates the session, all other connections for this remote site should be closed. Note that a user can submit a number of jobs, sign off, and later receive his output when he signs on again. C. Channel Control Flow control in NETRJS is handled by the Network protocol ALL mechanism. Before transmission of a stream of records can begin on a particular channel, the remote site must issue an RFC and Central must reply. This allows the central site to determine the remote Braden, et. al. [Page 3] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 configuration dynamically. A particular card reader, printer, or punch channel is open only while it is active, so the receiver need not tie up buffer space needlessly. Each of these channels, when open, assumes a buffer allocation of at least 900 bytes at the receiver. The operator input and output channels, on the other hand, are open throughout the session. On these channels the receiver must provide an allocation of at least 130 bytes. After sending the SIGNON command over the operator input channel, the remote site should send RFC's for all output channels which are ready to receive data. When output is available for that site, Central returns an RFC and begins transmission. Central closes an output channel (socket i and j) at the end of the output for each complete batch job.[4] The remote site must then send a new RFC and Central must reply with an RFC to start output for another job to that device. This gives the remote site a chance to allocate a new file for each job without breaking the output within a job. If the user at the remote site wants to cancel (or backspace or defer) the output of a particular job, he enters appropriate RJS commands[2] on the operator input channel. When the remote site is ready to submit a job (or stack of consecutive jobs), it issues an RFC for the card reader input channel. The remote site is not required to close the channel (socket c) after each job in a "stack" of jobs, but he must close it following the last job in the stack to initiate its processing. It may be necessary for the receiver site to abort a particular channel, perhaps due to a transmission error (see Section D below on checking) or a disk I/O error. The receiver may abort a channel (other than console output) by closing it (sockets d, e, f, and h). This action signals the transmitter to re-transmit the information after the channel has been reopened (initiated by the remote site, as always). The transmitter, on the other hand, aborts a channel by sending a block with a particular bit combination (e = 2 in BCBYTE; see Section E). If either site aborts card reader (input) channel, RJS will discard the text of the last partially-spooled job; the remote site should re-transmit this job. Note that repeating an entire stack will enter duplicate jobs into the system, but the second copy of a job will "flush" due to its duplicate job name. If a printer or punch (output) channel is aborted, Central will re- transmit from the beginning of the current SYSOUT data set; the effect is the same as a RESTART command.[2] Braden, et. al. [Page 4] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 If the operator input channel is aborted, the remote site must re- transmit the last _block_. Finally, the operator output channel has no abort condition defined. Central will never send Channel Abort message on this channel; if the remote site closes its socket (socket b), Central will not re-transmit, but simply cease sending messages until the channel is reopened. Therefore a remote site can operate without an operator output channel; however we do not recommend this, as the user will then miss operator advisory messages such as a warning of an impending IPL. D. Checking The nature of remote job entry service is such that a low rate of undetected errors is mandatory. The IMP's use CRC's and sequence numbers over the communication lines, so the effective IMP-IMP error rate should be negligible. Although there is no checking provided for the IMP-Host interface, it seems likely that these interfaces will either be reliable or fail catastrophically; it seems unlikely that "drop-outs" or other random failures will occur. Therefore only the following simple checks are provided: 1. Each block will (at least initially) contain a fixed bit check pattern using both on and off states of each bit path in the 16 bit PDA interface at CCN. It is anticipated that even this crude check on IMP-Host transmission will be useful both during the initial checkout of hardware and software and also later if the interface becomes marginal. However, either site can omit the check pattern if it sets a bit in the Block Control Byte (BCBYTE); see Section F. 2. Each block contains a sequence number. Again this is intended for initial checkout and to signal catastrophic hardware or software problems. If the receiver detects an incorrect check pattern or block sequence number, he aborts the channel by closing the corresponding network connection; the remote site should then issue an RFC to re-establish the network connection. The sequence number of the first block after an RFC is 0. The numbers are never reset while the connection is open. Braden, et. al. [Page 5] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 E. Block Format BLOCK <---- BLOCKHEAD + (RECORD = r) + ENDOFBLOCK Here r > 0 = BLOCKHEAD <-- BCBYTE + [e=0=>CHECK] + DEVBYTE The Blockhead field consists of a Block Control Byte, a 32-bit check field CHECK, and a Device Byte. BCBYTE <---- '1'BIT + e:ERRORCONTROL + b:BLKSEQ Here BLKSEQ contains a 5-bit modulo 32 block sequence number b. ERRORCONTROL is a 2 bit field with the following meanings: e=0 : Normal block. Contains a (presumably valid) check field CHECK. e=1 : Block contains no check field CHECK. e=2 : Abort channel, initiated by transmitter. Channels is not closed, transmission restarts on job-related boundary. DEVBYTE <---- '1'BIT + n:DEVNO + t:DEVTYPE This byte identifies a particular remote device, i.e., it identifies a stream. DEVTYPE specifies the type of device, as follows: t=1: Output to remote operator console. 2: Input from remote operator console. 3: Input from card reader. 4: Output to printer. 5: Output to card punch. 6,7: Unused. DEVNO is a 3-bit integer which identifies the particular device type of type t at this remote site. CHECK <--- '10101111'BYTE + 01010000'BYTE + '11111010'BYTE + '00000101'BYTE ENDOFBLOCK<----'0'BYTE Braden, et. al. [Page 6] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 Record Format RECORD <------ DATA RECORD | JOBNAMERECORD The first record sent on a printer or punch output channel will be a JOBNAMERECORD, identifying the OS/360 jobname of the job which produced the following output. DATARECORD <--- '10'BIT2 + DEVCNTRL + (STRING=p) + ENDOFRECORD JOBNAMERECORD <-- '11000000'BYTE + '11001000'BYTE + JOBNAME + ENDOFRECORD JOBNAME <---- (TEXTBYTE = 8) This is the 8-character OS/360 jobname for the following job. DEVCNTRL <----- d:BIT2 + k:BIT4 DEVCNTRL specifies carriage control for a printer, so if the device is not a printer then DEVCNTRL should be '000000'. For a printer: d=0 : Space k lines after printing; 0 < k < 3 = = is allowed d=2 : Immediately space k lines. d=1, k=1: Skip to top of new page after printing. d=3, k=1: Immediately skip to top of new page. STRING <--- ('100' + i:DUPCOUNT)| This is a string of i consecutive blanks. ('101' + i:DUPCOUNT + TEXTBYTE)| This is a string of i consecutive duplicates of TEXTBYTE. ('11' + j:LENGTH + (TEXTBYTE=j)| This is an uncompressed string of j characters. ENDOFRECORD <---- '0'BYTE Braden, et. al. [Page 7] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 G. Field Definitions Name* Meaning Length (bits) _____ _______ _____________ BIT 1-bit field 1 BIT2 2-bit field 2 BIT4 4-bit field 4 BLKSEQ Block sequence number 5 BYTE 8-bit field aligned on 8-bit 8 boundary CHECK Block check number 32 DEVNO Device number of a given 3 type DEVTYPE Device type 4 DUPCOUNT Number of replications of 5 duplicated character in compressed text. ERRORCONTROL Block transmission error 2 control. LENGTH Length in bytes of the 6 following string of text. TEXTBYTE An 8-bit byte of text 8 *Note: All non-terminal fields whose names end in "...BYTE" represent bytes in both length and alignment. Braden, et. al. [Page 8] RFC 88 NETRJS - A THIRD LEVEL PROTOCOL 13 January 1971 H. NOTES AND REFERENCES 1. Martin, V.A. and Springer, T.W., "Implementation of A Remote Job Service", Technical Report TR2, Campus Computing Network, UCLA, Los Angeles, (undated). 2. The RJS operator commands and messages are described in detail in Reference 1. 3. We use the phrase "starting a session" rather than "logging on" because RJS has its own log on procedure, which is, we suppose, a fourth-level protocol. 4. Note that NETRJS uses closing of connections as end-of-file signals. REMOTE SITE CENTRAL SITE (CCN) +---------------------+ +--------------------+ | a | | | | Console Input o----------->o f | | b | | | | Console Output o<-----------o g | | c | | | | Card Reader o------------o h | | d | | | | Printer o<-----------o i | | e | | | | Card Punch o<-----------o j | | | | | +---------------------+ +--------------------+ FIGURE 1 ARPA Network Connections (Channels) For a Standard Remote Site Under NETRJS R.T. Braden/rb. S.M. Wolfe [This RFC was put into machine readable form for entry] [into the online RFC archives by Lorrie Shiota, 10/01] Braden, et. al. [Page 9]