后端网络编程与通信原理
一、基础概念
不同设备之间通过网络进行数据传输,并且基于通用的网络协议作为多种设备的兼容标准,称为网络通信;
以CS架构来看,在一次请求当中,客户端和服务端进行数据传输的交互时,在不同阶段和层次中需要遵守的网络通信协议也不一样;
应用层:HTTP超文本传输协议,基于TCPIP通信协议来传递数据;
传输层:TCP传输控制协议,采用三次握手的方式建立连接,形成数据传输通道;
网络层:IP协议,作用是把各种传输的数据包发送给请求的接收方;
通信双方进行交互时,发送方数据在各层传输时,每通过一层就会添加该层的首部信息;接收方与之相反,每通过一次就会删除该层的首部信息;二、JDK源码
在java。net源码包中,提供了与网络编程相关的基础API;1、InetAddress
封装了对IP地址的相关操作,在使用该API之前可以先查看本机的hosts的映射,Linux系统中在etchosts路径下;importjava。net。InetAddress;publicclassTestInet{publicstaticvoidmain(String〔〕args)throwsException{获取本机InetAddress对象InetAddresslocalHostInetAddress。getLocalHost();printInetAddress(localHost);获取指定域名InetAddress对象InetAddressinetAddressInetAddress。getByName(www。baidu。com);printInetAddress(inetAddress);获取本机配置InetAddress对象InetAddressconfAddressInetAddress。getByName(nacosservice);printInetAddress(confAddress);}publicstaticvoidprintInetAddress(InetAddressinetAddress){System。out。println(InetAddress:inetAddress);System。out。println(主机名:inetAddress。getHostName());System。out。println(IP地址:inetAddress。getHostAddress());}}2、URL
统一资源定位符,URL一般包括:协议、主机名、端口、路径、查询参数、锚点等,路径查询参数,也被称为文件;
importjava。net。URL;publicclassTestURL{publicstaticvoidmain(String〔〕args)throwsException{URLurlnewURL(https:www。baidu。com:80s?wdJavabd);printURL(url);}privatestaticvoidprintURL(URLurl){System。out。println(协议:url。getProtocol());System。out。println(域名:url。getHost());System。out。println(端口:url。getPort());System。out。println(路径:url。getPath());System。out。println(参数:url。getQuery());System。out。println(文件:url。getFile());System。out。println(锚点:url。getRef());}}3、HttpURLConnection
作为URLConnection的抽象子类,用来处理针对Http协议的请求,可以设置连接超时、读取超时、以及请求的其他属性,是服务间通信的常用方式;publicclassTestHttp{publicstaticvoidmain(String〔〕args)throwsException{访问网址内容URLurlnewURL(https:www。jd。com);HttpURLConnectionhttpUrlConnection(HttpURLConnection)url。openConnection();printHttp(httpUrlConnection);请求服务接口URLapinewURL(http:localhost:8082info99);HttpURLConnectionapiConnection(HttpURLConnection)api。openConnection();apiConnection。setRequestMethod(GET);apiConnection。setConnectTimeout(3000);printHttp(apiConnection);}privatestaticvoidprintHttp(HttpURLConnectionhttpUrlConnection)throwsException{try(InputStreaminputStreamhttpUrlConnection。getInputStream()){BufferedReaderbufferedReadernewBufferedReader(newInputStreamReader(inputStream,StandardCharsets。UTF8));Stringline;while((linebufferedReader。readLine())!null){System。out。println(line);}}}}三、通信编程1、Socket
Socket也被称为套接字,是两台设备之间通信的端点,会把网络连接当成流处理,则数据以IO形式传输,这种方式在当前被普遍采用;
从网络编程直接跳到Socket套接字,概念上确实有较大跨度,概念过度抽象时,可以看看源码的核心结构,在理解时会轻松很多,在JDK中重点看SocketImpl抽象类;publicabstractclassSocketImplimplementsSocketOptions{Socket对象,客户端和服务端Socketsocketnull;ServerSocketserverSocketnull;套接字的文件描述对象protectedFileDescriptorfd;套接字的路由IP地址protectedInetAddressaddress;套接字连接到的远程主机上的端口号protectedintport;套接字连接到的本地端口号protectedintlocalport;}
套接字的抽象实现类,是实现套接字的所有类的公共超类,可以用于创建客户端和服务器套接字;
所以到底如何理解Socket概念?从抽象类中来看,套接字就是指代网络通讯中系统资源的核心标识,比如通讯方IP地址、端口、状态等;2、SocketServer
创建Socket服务端,并且在8989端口监听,接收客户端的连接请求和相关信息,并且响应客户端,发送指定的数据;publicclassSocketServer{publicstaticvoidmain(String〔〕args)throwsException{1、创建Socket服务端ServerSocketserverSocketnewServerSocket(8989);System。out。println(socketserver:8989,waitingconnect。。。);2、方法阻塞等待,直到有客户端连接SocketsocketserverSocket。accept();System。out。println(socketserver:8989,getconnect:socket。getPort());3、输入流,输出流InputStreaminStreamsocket。getInputStream();OutputStreamoutStreamsocket。getOutputStream();4、数据接收和响应byte〔〕bufnewbyte〔1024〕;intreadLen0;while((readLeninStream。read(buf))!1){接收数据StringreadVarnewString(buf,0,readLen);if(exit。equals(readVar)){break;}System。out。println(recv:readVar;time:DateTime。now()。toString(DatePattern。NORMDATETIMEPATTERN));响应数据outStream。write((resptime:DateTime。now()。toString(DatePattern。NORMDATETIMEPATTERN))。getBytes());}5、资源关闭outStream。close();inStream。close();socket。close();serverSocket。close();System。out。println(socketserver:8989,exit。。。);}}
需要注意的是步骤2输出的端口号是随机不确定的,结合jps和lsofitcp:port命令查看进程和端口号的占用情况;3、SocketClient
创建Socket客户端,并且连接到服务端,读取命令行输入的内容并发送到服务端,并且输出服务端的响应数据;publicclassSocketClient{publicstaticvoidmain(String〔〕args)throwsException{1、创建Socket客户端SocketsocketnewSocket(InetAddress。getLocalHost(),8989);System。out。println(serverclient,connectto:8989);2、输入流,输出流OutputStreamoutStreamsocket。getOutputStream();InputStreaminStreamsocket。getInputStream();3、数据发送和响应接收intreadLen0;byte〔〕bufnewbyte〔1024〕;while(true){读取命令行输入BufferedReaderbufReadernewBufferedReader(newInputStreamReader(System。in));StringiptLinebufReader。readLine();if(exit。equals(iptLine)){break;}发送数据outStream。write(iptLine。getBytes());接收数据if((readLeninStream。read(buf))!1){System。out。println(newString(buf,0,readLen));}}4、资源关闭inStream。close();outStream。close();socket。close();System。out。println(socketclient,getexitcommand);}}
测试结果:整个流程在没有收到客户端的exit退出指令前,会保持连接的状态,并且可以基于字节流模式,进行持续的数据传输;
4、字符流使用
基于上述的基础案例,采用字符流的方式进行数据传输,客户端和服务端只进行一次简单的交互;1、客户端BufferedReaderbufReadernewBufferedReader(newInputStreamReader(inStream));BufferedWriterbufWriternewBufferedWriter(newOutputStreamWriter(outStream));客户端发送数据bufWriter。write(hello,server);bufWriter。newLine();bufWriter。flush();客户端接收数据System。out。println(clientread:bufReader。readLine());2、服务端BufferedReaderbufReadernewBufferedReader(newInputStreamReader(inStream));BufferedWriterbufWriternewBufferedWriter(newOutputStreamWriter(outStream));服务端接收数据System。out。println(serverread:bufReader。readLine());服务端响应数据bufWriter。write(hello,client);bufWriter。newLine();bufWriter。flush();5、文件传输
基于上述的基础案例,客户端向服务端发送图片文件,服务端完成文件的读取和保存,在处理完成后给客户端发送结果描述;1、客户端客户端发送图片FileInputStreamfileStreamnewFileInputStream(LocalFilePathjvm。png);byte〔〕bytesnewbyte〔1024〕;inti0;while((ifileStream。read(bytes))!1){outStream。write(bytes);}写入结束标记,禁用此套接字的输出流,之后再使用输出流会抛异常socket。shutdownOutput();接收服务端响应结果System。out。println(serverresp:newString(bytes,0,readLen));2、服务端接收客户端图片FileOutputStreamfileOutputStreamnewFileOutputStream(LocalFilePathnewjvm。png);byte〔〕bytesnewbyte〔1024〕;inti0;while((iinStream。read(bytes))!1){fileOutputStream。write(bytes,0,i);}响应客户端文件处理结果outStream。write(filesavesuccess。getBytes());6、TCP协议
Socket网络编程是基于TCP协议的,TCP传输控制协议是一种面向连接的、可靠的、基于字节流的传输层通信协议,在上述案例中侧重基于流的数据传输,其中关于连接还涉及两个核心概念:
三次握手:建立连接的过程,在这个过程中进行了三次网络通信,当连接处于建立的状态,就可以进行正常的通信,即数据传输;四次挥手:关闭连接的过程,调用close方法,即连接使用结束,在这个过程中进行了四次网络通信;四、Http组件
在服务通信时依赖网络,而对于编程来说,更常见的是的Http的组件,在微服务架构中,涉及到Http组件工具有很多,例如Spring框架中的RestTemplate,Feign框架支持ApacheHttp和OkHttp;下面围绕几个常用的组件编写测试案例;1、基础接口RestControllerpublicclassBizWeb{GetMapping(getApi{id})publicRepIntegergetApi(PathVariableIntegerid){log。info(id{},id);returnRep。ok(id);}GetMapping(getApiv2{id})publicRepIntegergetApiV2(HttpServletRequestrequest,PathVariableIntegerid,RequestParam(name)Stringname){Stringtokenrequest。getHeader(Token);log。info(token{},id{},name{},token,id,name);returnRep。ok(id);}PostMapping(postApi)publicRepIdKeypostApi(HttpServletRequestrequest,RequestBodyIdKeyidKey){Stringtokenrequest。getHeader(Token);log。info(token{},idKey{},token,JSONUtil。toJsonStr(idKey));returnRep。ok(idKey);}PutMapping(putApi)publicRepIdKeyputApi(RequestBodyIdKeyidKey){log。info(idKey{},JSONUtil。toJsonStr(idKey));returnRep。ok(idKey);}DeleteMapping(delApi{id})publicRepIntegerdelApi(PathVariableIntegerid){log。info(id{},id);returnRep。ok(id);}}2、ApacheHttppublicclassTestApacheHttp{privatestaticfinalStringBASEURLhttp:localhost:8083;publicstaticvoidmain(String〔〕args){BasicHeaderheadernewBasicHeader(Token,ApacheSup);1、发送Get请求MapString,StringparamnewHashMap();param。put(name,cicada);RepgetRepdoGet(BASEURLgetApiv23,header,param,Rep。class);System。out。println(get:getRep);2、发送Post请求IdKeypostBodynewIdKey(1,idkey我);ReppostRepdoPost(BASEURLpostApi,header,postBody,Rep。class);System。out。println(post:postRep);}构建HttpClient对象privatestaticCloseableHttpClientbuildHttpClient(){请求配置RequestConfigreqConfigRequestConfig。custom()。setConnectTimeout(6000)。build();returnHttpClients。custom()。setDefaultRequestConfig(reqConfig)。build();}执行Get请求publicstaticTTdoGet(Stringurl,Headerheader,MapString,Stringparam,ClassTrepClass){创建Get请求CloseableHttpClienthttpClientbuildHttpClient();HttpGethttpGetnewHttpGet();httpGet。addHeader(header);try{URIBuilderbuildernewURIBuilder(url);if(param!null){for(Stringkey:param。keySet()){builder。addParameter(key,param。get(key));}}httpGet。setURI(builder。build());请求执行HttpResponsehttpResponsehttpClient。execute(httpGet);if(httpResponse。getStatusLine()。getStatusCode()200){结果转换StringrespEntityUtils。toString(httpResponse。getEntity());returnJSONUtil。toBean(resp,repClass);}}catch(Exceptione){e。printStackTrace();}finally{IoUtil。close(httpClient);}returnnull;}执行Post请求publicstaticTTdoPost(Stringurl,Headerheader,Objectbody,ClassTrepClass){创建Post请求CloseableHttpClienthttpClientbuildHttpClient();HttpPosthttpPostnewHttpPost(url);httpPost。addHeader(header);StringEntityconBodynewStringEntity(JSONUtil。toJsonStr(body),ContentType。APPLICATIONJSON);httpPost。setEntity(conBody);try{请求执行HttpResponsehttpResponsehttpClient。execute(httpPost);if(httpResponse。getStatusLine()。getStatusCode()200){结果转换StringrespEntityUtils。toString(httpResponse。getEntity());returnJSONUtil。toBean(resp,repClass);}}catch(Exceptione){e。printStackTrace();}finally{IoUtil。close(httpClient);}returnnull;}}3、OkHttppublicclassTestOkHttp{privatestaticfinalStringBASEURLhttp:localhost:8083;publicstaticvoidmain(String〔〕args){HeadersheadersnewHeaders。Builder()。add(Token,OkHttpSup)。build();1、发送Get请求RepgetRepexecute(BASEURLgetApi1,Method。GET。name(),headers,null,Rep。class);System。out。println(get:getRep);2、发送Post请求IdKeypostBodynewIdKey(1,idkey);ReppostRepexecute(BASEURLpostApi,Method。POST。name(),headers,buildBody(postBody),Rep。class);System。out。println(post:postRep);3、发送Put请求IdKeyputBodynewIdKey(2,keyid);RepputRepexecute(BASEURLputApi,Method。PUT。name(),headers,buildBody(putBody),Rep。class);System。out。println(put:putRep);4、发送Delete请求RepdelRepexecute(BASEURLdelApi2,Method。DELETE。name(),headers,null,Rep。class);System。out。println(del:delRep);}构建JSON请求体publicstaticRequestBodybuildBody(Objectbody){MediaTypemediaTypeMediaType。parse(applicationjson;charsetutf8);returnRequestBody。create(mediaType,JSONUtil。toJsonStr(body));}构建OkHttpClient对象publicstaticOkHttpClientbuildOkHttp(){returnnewOkHttpClient。Builder()。readTimeout(10,TimeUnit。SECONDS)。connectTimeout(6,TimeUnit。SECONDS)。connectionPool(newConnectionPool(15,5,TimeUnit。SECONDS))。build();}执行请求publicstaticTTexecute(Stringurl,Stringmethod,Headersheaders,RequestBodybody,ClassTrepClass){请求创建OkHttpClienthttpClientbuildOkHttp();Request。BuilderrequestBuildnewRequest。Builder()。url(url)。method(method,body);if(headers!null){requestBuild。headers(headers);}try{请求执行ResponseresponsehttpClient。newCall(requestBuild。build())。execute();结果转换InputStreaminStreamnull;if(response。isSuccessful()){ResponseBodyresponseBodyresponse。body();if(responseBody!null){inStreamresponseBody。byteStream();}}if(inStream!null){try{byte〔〕respByteIoUtil。readBytes(inStream);if(respByte!null){returnJSONUtil。toBean(newString(respByte,Charset。defaultCharset()),repClass);}}catch(Exceptione){e。printStackTrace();}finally{IoUtil。close(inStream);}}}catch(Exceptione){e。printStackTrace();}returnnull;}}4、RestTemplatepublicclassTestRestTemplate{privatestaticfinalStringBASEURLhttp:localhost:8083;publicstaticvoidmain(String〔〕args){RestTemplaterestTemplatebuildRestTemplate();1、发送Get请求MapString,StringparamMapnewHashMap();RepgetReprestTemplate。getForObject(BASEURLgetApi1,Rep。class,paramMap);System。out。println(get:getRep);2、发送Post请求IdKeyidKeynewIdKey(1,idkey);ReppostReprestTemplate。postForObject(BASEURLpostApi,idKey,Rep。class);System。out。println(post:postRep);3、发送Put请求IdKeyidKey2newIdKey(2,keyid);restTemplate。put(BASEURLputApi,idKey2,paramMap);4、发送Delete请求restTemplate。delete(BASEURLdelApi2,paramMap);5、自定义Header请求HttpHeadersheadersnewHttpHeaders();headers。add(Token,AdminSup);HttpEntityIdKeyrequestEntitynewHttpEntity(idKey,headers);ResponseEntityReprespEntityrestTemplate。exchange(BASEURLpostApi,HttpMethod。POST,requestEntity,Rep。class);System。out。println(postheader:respEntity。getBody());}privatestaticRestTemplatebuildRestTemplate(){1、参数配置SimpleClientHttpRequestFactoryfactorynewSimpleClientHttpRequestFactory();factory。setReadTimeout(3000);factory。setConnectTimeout(6000);2、创建对象returnnewRestTemplate(factory);}}五、参考源码编程文档:https:gitee。comcicadasmilebuttejavanote应用仓库:https:gitee。comcicadasmilebutteflyerparent
文章来源:知了一笑https:developer。aliyun。comarticle1109409