基于centos 6.5使用varnish实现网站动静分离
<p><strong>一、varnish简介</strong><br><br>
varnish是一款高性能、开源的反向代理服务器和缓存服务器，其开发者poul-henning kamp是freebsd核心的开发人员之一。<br>
varnish主要运行两个进程：management进程和child进程(也叫cache进程)。<br>
management进程主要实现应用新的配置、编译vcl、监控varnish、初始化varnish以及提供一个命令行接口等。management进程会每隔几秒钟探测一下child进程以判断其是否正常运行，如果在指定的时长内未得到child进程的回应，management将会重启此child进程。<br><br><strong>二、varnish工作流程</strong><br><br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/e7e66c26f613e687a4e5d4fdb4d6836d.jpg"><br>
1)、varnish从客户端接收请求后，由vcl_recv状态引擎处理，不能识别的请求将会通过参数pipe交给vcl_pipe状态引擎，需要查找缓存的请求通过lookup参数将会交给vcl_hash状态引擎，无需缓存的数据通过参数pass将会交给 vcl_pass状态引擎；<br>
2)、vcl_hash状态引擎在接收到请求后会从缓存中查找数据，查询结果有两种，一种是hit缓存命中，另一种是miss缓存未命中；<br>
3)、vcl_hit状态引擎将命中的缓存数据通过参数deliver交给vcl_deliver状态引擎，vcl_deliver状态引擎将数据处理后，最终返回给客户端；<br>
4)、vcl_miss状态引擎将未命中的结果参数fetch交给vcl_fetch状态引擎，vcl_fetch状态引擎将会从数据库中查找数据；<br>
5)、vcl_fetch状态引擎将从数据库中查询到的结果，返回给vcl_deliver状态引擎；<br>
6)、vcl_deliver状态引擎将结果返回给master进程，最终返回给客户端；<br><br><strong>三、使用varnish实现网站动静分离</strong><br><br>
实验环境，三台虚拟机<br>
linux：centos6.5<br>
varnish：varnish-3.0.4-1.el6.x86_64<br>
nginx：nginx-1.4.7<br>
varnish主机：两块网卡，外网ip 172.16.36.10，内网ip 192.168.0.10<br>
web服务器1：ip 192.168.0.20，用于作静态文件服务器<br>
web服务器2：ip 192.168.0.30，用于作动态程序服务器<br>
前提说明：<br>
varnish的配置文件为vcl后缀，位于/etc/varnish/目录，缓存通常用于提升响应速度，一般而言，可以缓存html静态页面、图片、js脚本、css样式表，因为动态脚本语言编写的页面需要使用脚本引擎处理，因此没有缓存的必要性；nginx本身就有缓存及反向代理功能，完全可以实现web服务的动静分离，不过以缓存功能作对比，varnish的缓存显然比nginx更专业，所以要作缓存服务器，可以试试varnish，本次操作将以实验性的目的，使用varnish实现web服务动静分离；<br>
1、安装varnish<br>
# rpm -ivh varnish-3.0.4-1.el6.x86_64.rpm varnish-docs-3.0.4-1.el6.x86_64.rpm varnish-libs-3.0.4-1.el6.x86_64.rpm<br>
2、配置varnish<br>
1)、编辑varnish脚本的配置文件/etc/sysconfig/varnish，将varnish监听的端口修改为80；<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/05006837acda589b2582cfca7acaa988.jpg"><br>
2)、新建文件/etc/varnish/web.vcl，编辑varnish缓存规则；</p>
<div class="jb51code">
<div>
<div class="syntaxhighlighterplain" id="highlighter_726954">
<div class="toolbar">
<span>?</span>
</div>
<table border="0" cellpadding="0" cellspacing="0"><tbody><tr>
<td class="gutter">
<div class="line number1 index0 alt2">
1</div>
<div class="line number2 index1 alt1">
2</div>
<div class="line number3 index2 alt2">
3</div>
<div class="line number4 index3 alt1">
4</div>
<div class="line number5 index4 alt2">
5</div>
<div class="line number6 index5 alt1">
6</div>
<div class="line number7 index6 alt2">
7</div>
<div class="line number8 index7 alt1">
8</div>
<div class="line number9 index8 alt2">
9</div>
<div class="line number10 index9 alt1">
10</div>
<div class="line number11 index10 alt2">
11</div>
<div class="line number12 index11 alt1">
12</div>
<div class="line number13 index12 alt2">
13</div>
<div class="line number14 index13 alt1">
14</div>
<div class="line number15 index14 alt2">
15</div>
<div class="line number16 index15 alt1">
16</div>
<div class="line number17 index16 alt2">
17</div>
<div class="line number18 index17 alt1">
18</div>
<div class="line number19 index18 alt2">
19</div>
<div class="line number20 index19 alt1">
20</div>
<div class="line number21 index20 alt2">
21</div>
<div class="line number22 index21 alt1">
22</div>
<div class="line number23 index22 alt2">
23</div>
<div class="line number24 index23 alt1">
24</div>
<div class="line number25 index24 alt2">
25</div>
<div class="line number26 index25 alt1">
26</div>
<div class="line number27 index26 alt2">
27</div>
<div class="line number28 index27 alt1">
28</div>
<div class="line number29 index28 alt2">
29</div>
<div class="line number30 index29 alt1">
30</div>
<div class="line number31 index30 alt2">
31</div>
<div class="line number32 index31 alt1">
32</div>
<div class="line number33 index32 alt2">
33</div>
<div class="line number34 index33 alt1">
34</div>
<div class="line number35 index34 alt2">
35</div>
<div class="line number36 index35 alt1">
36</div>
<div class="line number37 index36 alt2">
37</div>
<div class="line number38 index37 alt1">
38</div>
<div class="line number39 index38 alt2">
39</div>
<div class="line number40 index39 alt1">
40</div>
<div class="line number41 index40 alt2">
41</div>
<div class="line number42 index41 alt1">
42</div>
<div class="line number43 index42 alt2">
43</div>
<div class="line number44 index43 alt1">
44</div>
<div class="line number45 index44 alt2">
45</div>
<div class="line number46 index45 alt1">
46</div>
<div class="line number47 index46 alt2">
47</div>
<div class="line number48 index47 alt1">
48</div>
<div class="line number49 index48 alt2">
49</div>
<div class="line number50 index49 alt1">
50</div>
<div class="line number51 index50 alt2">
51</div>
<div class="line number52 index51 alt1">
52</div>
<div class="line number53 index52 alt2">
53</div>
<div class="line number54 index53 alt1">
54</div>
<div class="line number55 index54 alt2">
55</div>
<div class="line number56 index55 alt1">
56</div>
<div class="line number57 index56 alt2">
57</div>
<div class="line number58 index57 alt1">
58</div>
<div class="line number59 index58 alt2">
59</div>
<div class="line number60 index59 alt1">
60</div>
<div class="line number61 index60 alt2">
61</div>
<div class="line number62 index61 alt1">
62</div>
<div class="line number63 index62 alt2">
63</div>
<div class="line number64 index63 alt1">
64</div>
<div class="line number65 index64 alt2">
65</div>
<div class="line number66 index65 alt1">
66</div>
</td>
<td class="code">
<div class="container">
<div class="line number1 index0 alt2">
<code class="plain plain">#定义后端服务器</code>
</div>
<div class="line number2 index1 alt1">
<code class="plain plain">backend web1 {</code>
</div>
<div class="line number3 index2 alt2">
<code class="plain spaces"> </code><code class="plain plain">.host="192.168.0.20";</code>
</div>
<div class="line number4 index3 alt1">
<code class="plain spaces"> </code><code class="plain plain">.port="80";</code>
</div>
<div class="line number5 index4 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number6 index5 alt1">
<code class="plain plain">backend web2 {</code>
</div>
<div class="line number7 index6 alt2">
<code class="plain spaces"> </code><code class="plain plain">.host="192.168.0.30";</code>
</div>
<div class="line number8 index7 alt1">
<code class="plain spaces"> </code><code class="plain plain">.port="80";</code>
</div>
<div class="line number9 index8 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number10 index9 alt1">
<code class="plain plain">#只允许本机使用purgers请求方法清除缓存</code>
</div>
<div class="line number11 index10 alt2">
<code class="plain plain">acl purgers {</code>
</div>
<div class="line number12 index11 alt1">
<code class="plain spaces"> </code><code class="plain plain">"127.0.0.1";</code>
</div>
<div class="line number13 index12 alt2">
<code class="plain spaces"> </code><code class="plain plain">"172.16.0.0"/16;</code>
</div>
<div class="line number14 index13 alt1">
<code class="plain plain">}</code>
</div>
<div class="line number15 index14 alt2">
<code class="plain plain">sub vcl_recv {</code>
</div>
<div class="line number16 index15 alt1">
<code class="plain spaces"> </code><code class="plain plain">if(req.request=="purge"){</code>
</div>
<div class="line number17 index16 alt2">
<code class="plain spaces"> </code><code class="plain plain">if(!client.ip~purgers) {</code>
</div>
<div class="line number18 index17 alt1">
<code class="plain spaces"> </code><code class="plain plain">error 405 "mothod not allow";</code>
</div>
<div class="line number19 index18 alt2">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number20 index19 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number21 index20 alt2">
<code class="plain plain">#静态资源交给web1服务器</code>
</div>
<div class="line number22 index21 alt1">
<code class="plain spaces"> </code><code class="plain plain">if(req.url ~ "\.(html|htm|shtml|css|js|jpg|png|gif|jpeg)"){</code>
</div>
<div class="line number23 index22 alt2">
<code class="plain spaces"> </code><code class="plain plain">set req.backend=web1;</code>
</div>
<div class="line number24 index23 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number25 index24 alt2">
<code class="plain plain">#php页面交给web2服务器，并跳过缓存</code>
</div>
<div class="line number26 index25 alt1">
<code class="plain spaces"> </code><code class="plain plain">if(req.url ~ "\.php") {</code>
</div>
<div class="line number27 index26 alt2">
<code class="plain spaces"> </code><code class="plain plain">set req.backend=web2;</code>
</div>
<div class="line number28 index27 alt1">
<code class="plain spaces"> </code><code class="plain plain">return(pass);</code>
</div>
<div class="line number29 index28 alt2">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number30 index29 alt1">
<code class="plain spaces"> </code><code class="plain plain">return(lookup);</code>
</div>
<div class="line number31 index30 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number32 index31 alt1">
<code class="plain plain">#将命中的缓存清除</code>
</div>
<div class="line number33 index32 alt2">
<code class="plain plain">sub vcl_hit {</code>
</div>
<div class="line number34 index33 alt1">
<code class="plain spaces"> </code><code class="plain plain">if (req.request == "purge") {</code>
</div>
<div class="line number35 index34 alt2">
<code class="plain spaces"> </code><code class="plain plain">purge;</code>
</div>
<div class="line number36 index35 alt1">
<code class="plain spaces"> </code><code class="plain plain">error 200 "purged ok";</code>
</div>
<div class="line number37 index36 alt2">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number38 index37 alt1">
<code class="plain plain">}</code>
</div>
<div class="line number39 index38 alt2">
<code class="plain plain">#如果请求清除的资源不在缓存列表中，返回404状态</code>
</div>
<div class="line number40 index39 alt1">
<code class="plain plain">sub vcl_miss {</code>
</div>
<div class="line number41 index40 alt2">
<code class="plain spaces"> </code><code class="plain plain">if (req.request == "purge") {</code>
</div>
<div class="line number42 index41 alt1">
<code class="plain spaces"> </code><code class="plain plain">purge;</code>
</div>
<div class="line number43 index42 alt2">
<code class="plain spaces"> </code><code class="plain plain">error 404 "not in cache";</code>
</div>
<div class="line number44 index43 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number45 index44 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number46 index45 alt1">
<code class="plain plain">#如果请求清除的资源是一个不可缓存的资源，返回502状态</code>
</div>
<div class="line number47 index46 alt2">
<code class="plain plain">sub vcl_pass {</code>
</div>
<div class="line number48 index47 alt1">
<code class="plain spaces"> </code><code class="plain plain">if (req.request == "purge") {</code>
</div>
<div class="line number49 index48 alt2">
<code class="plain spaces"> </code><code class="plain plain">error 502 "purged on a passed object.";</code>
</div>
<div class="line number50 index49 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number51 index50 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number52 index51 alt1">
<code class="plain plain">#缓存对象存活时间</code>
</div>
<div class="line number53 index52 alt2">
<code class="plain plain">sub vcl_fetch {</code>
</div>
<div class="line number54 index53 alt1">
<code class="plain spaces"> </code><code class="plain plain">if(req.url ~ "\.(html|htm|shtml|css|js|jpg|png|gif|jpeg)"){</code>
</div>
<div class="line number55 index54 alt2">
<code class="plain spaces"> </code><code class="plain plain">set beresp.ttl=7200s;</code>
</div>
<div class="line number56 index55 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number57 index56 alt2">
<code class="plain plain">}</code>
</div>
<div class="line number58 index57 alt1">
<code class="plain plain">#将结果返回给客户端并在响应头部添加两字段，显示命中与否，并显示后端响应的web服务器</code>
</div>
<div class="line number59 index58 alt2">
<code class="plain plain">sub vcl_deliver {</code>
</div>
<div class="line number60 index59 alt1">
<code class="plain spaces"> </code><code class="plain plain">if(obj.hits > 0) {</code>
</div>
<div class="line number61 index60 alt2">
<code class="plain spaces"> </code><code class="plain plain">set resp.http.x-cache="hit from" + " " + server.ip;</code>
</div>
<div class="line number62 index61 alt1">
<code class="plain spaces"> </code><code class="plain plain">}else{</code>
</div>
<div class="line number63 index62 alt2">
<code class="plain spaces"> </code><code class="plain plain">set resp.http.x-cache="miss";</code>
</div>
<div class="line number64 index63 alt1">
<code class="plain spaces"> </code><code class="plain plain">}</code>
</div>
<div class="line number65 index64 alt2">
<code class="plain spaces"> </code><code class="plain plain">set resp.http.backend-ip=req.backend;</code>
</div>
<div class="line number66 index65 alt1">
<code class="plain plain">}</code>
</div>
</div>
</td>
</tr></tbody></table>
</div>
</div>
</div>
<p>
3)、将配置加载至varnish；<br><br>
3.1)、连接varnish；<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/7c4533c2e44f5e4a1030ca068ffdd716.jpg"><br>
3.2)、加载配置；<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/f8b710ab1ec9ba92c0d3346900ca518c.jpg"><br>
3.3)、使用配置；<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/704b36ea08e6eeae777f62d06c547daa.jpg"><br>
4)、配置两台web服务器，分别安装nginx与php；<br>
192.168.0.20服务器，新建两页面，index.html与index.php，两页面请求输出结果如下：<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/bbfe7facf513be75d8956a7f0693f271.jpg"><br>
192.168.0.30服务器，新建两页面，index.html与index.php，两页面请求输出结果如下：<br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/2f30888ae798c36ad6da879e2fe2d178.jpg"><br>
5)、测试结果，打开地址：172.16.36.10；<br><br>
当我们请求html页面时，无论我们怎么刷新请求，缓存总是命中，并显示hit，并且后端服务器一直是，web1(192.168.0.20)；<br><br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/70afc13cc3b8618b20f1025a119b0263.jpg"><br><br>
当我们请求php页面时，我们不让他缓存，那么缓存也就永远不会命中，显示miss，并且后端服务器一直是，web2(192.168.0.30)；<br><br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/a5c4cfcae17a52917d3eecb5c483cb10.jpg"><br><br>
6)、清除缓存；<br><br><img style="max-width:100%!important;height:auto!important;"title="基于centos 6.5使用varnish实现网站动静分离" alt="基于centos 6.5使用varnish实现网站动静分离" src="https://zhuji.jb51.net/uploads/img/202305/cdf200cc6b773fb5b00857dd18eeb0a0.jpg"><br>
整个配置完成，varnish实现了动静分离；</p>
頁:
[1]