登录注册
Quick Links : Mindat手册The Rock H. Currier Digital LibraryMindat Newsletter [Free Download]
主页关于 MindatMindat手册Mindat的历史版权Who We Are联系我们于 Mindat.org刊登广告
捐赠给 MindatCorporate Sponsorship赞助板页已赞助的板页在 Mindat刊登 广告的广告商于 Mindat.org刊登广告
Learning CenterWhat is a mineral?The most common minerals on earthInformation for EducatorsMindat ArticlesThe ElementsThe Rock H. Currier Digital LibraryGeologic Time
搜索矿物的性质搜索矿物的化学Advanced Locality Search随意显示任何一 种矿物Random Locality使用minID搜索邻近产地Search Articles搜索词汇表更多搜索选项
搜索:
矿物名称:
地区产地名称:
关键字:
 
Mindat手册添加新照片Rate Photos产区编辑报告Coordinate Completion Report添加词汇表项目
Mining Companies统计会员列表Mineral MuseumsClubs & Organizations矿物展及活动The Mindat目录表设备设置The Mineral Quiz
照片搜索Photo GalleriesSearch by Color今天最新的照片昨天最新的照片用户照片相集过去每日精选照片相集Photography

GeneralBad performance today - Please blame Statoil!

22nd Sep 2011 21:59 UTCJolyon Ralph Founder

Hi everyone.


The server wasn't great today - with quite a bit of downtime. On investigating, I found the server was being tied up by a very poorly executed script run by someone at Statoil (statoil.com) which was trying to download all our mineral pages in quick succession.


Here's a very small segment from the log:


ibv2.statoil.com - - <22/Sep/2011:20:33:22 +0000> "GET /min-16611.html HTTP/1.1" 200 22024 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:27 +0000> "GET /min-25531.html HTTP/1.1" 200 22191 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:32 +0000> "GET /min-25536.html HTTP/1.1" 200 22916 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:38 +0000> "GET /min-25526.html HTTP/1.1" 200 22588 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:43 +0000> "GET /min-25533.html HTTP/1.1" 200 22307 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:48 +0000> "GET /min-25530.html HTTP/1.1" 200 22129 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:53 +0000> "GET /min-25534.html HTTP/1.1" 200 22662 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:33:58 +0000> "GET /min-2860.html HTTP/1.1" 200 70600 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:03 +0000> "GET /min-25538.html HTTP/1.1" 200 23405 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:08 +0000> "GET /min-16610.html HTTP/1.1" 200 22014 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:13 +0000> "GET /min-20171.html HTTP/1.1" 200 22184 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:18 +0000> "GET /min-20170.html HTTP/1.1" 200 22176 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:23 +0000> "GET /min-25537.html HTTP/1.1" 200 22116 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:28 +0000> "GET /min-25535.html HTTP/1.1" 200 22041 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:33 +0000> "GET /min-27028.html HTTP/1.1" 200 22003 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:38 +0000> "GET /min-40144.html HTTP/1.1" 200 48002 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:43 +0000> "GET /min-5304.html HTTP/1.1" 200 22175 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:48 +0000> "GET /min-2861.html HTTP/1.1" 200 107805 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:53 +0000> "GET /min-31206.html HTTP/1.1" 200 22121 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:34:58 +0000> "GET /min-30733.html HTTP/1.1" 200 22697 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:03 +0000> "GET /min-30678.html HTTP/1.1" 200 22961 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:08 +0000> "GET /min-16612.html HTTP/1.1" 200 22147 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:13 +0000> "GET /min-40350.html HTTP/1.1" 200 25908 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:18 +0000> "GET /min-30677.html HTTP/1.1" 200 22961 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:23 +0000> "GET /min-3695.html HTTP/1.1" 200 70189 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:28 +0000> "GET /min-5901.html HTTP/1.1" 200 22079 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:33 +0000> "GET /min-2864.html HTTP/1.1" 200 54065 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:38 +0000> "GET /min-16614.html HTTP/1.1" 200 22044 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:43 +0000> "GET /min-2862.html HTTP/1.1" 200 53391 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:48 +0000> "GET /min-16615.html HTTP/1.1" 200 22101 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:53 +0000> "GET /min-3694.html HTTP/1.1" 200 77867 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:35:58 +0000> "GET /min-30405.html HTTP/1.1" 200 22973 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:03 +0000> "GET /min-16616.html HTTP/1.1" 200 22127 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:08 +0000> "GET /min-2863.html HTTP/1.1" 200 65462 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:13 +0000> "GET /min-31910.html HTTP/1.1" 200 18577 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:34 +0000> "GET /min-31669.html HTTP/1.1" 200 18577 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:24 +0000> "GET /min-29814.html HTTP/1.1" 200 18577 "-" "MSIE 5.0"

ibv2.statoil.com - - <22/Sep/2011:20:36:18 +0000> "GET /min-16617.html HTTP/1.1" 200 18577 "-" "MSIE 5.0"



Statoil are now banned from mindat.org so hopefully the problem will go away. Sorry for the inconvenience.


Jolyon

22nd Sep 2011 22:25 UTCPeter Andresen Expert

I promise, I shal not fill gasoline at statoil tomorrow or next time!

22nd Sep 2011 22:35 UTCJolyon Ralph Founder

This wasn't the ONLY problem, but it was a contributing factor.


Jolyon

23rd Sep 2011 00:44 UTCRobert Knox

Always nice to know that it's not some malware problem on our computers.

23rd Sep 2011 00:44 UTCPaul Brandes 🌟 Manager

Statoil????? That's interesting......

23rd Sep 2011 03:48 UTCScott L. Ritchie Expert

Let's see here, Statoil gives the University of Texas five million dollars to further education, yet allow their IT gang to pilfer data from mindat on the sly... and they won't purchase a single advert here or make a simple donation to help keep the server up and running?


Scott

23rd Sep 2011 06:23 UTCRock Currier Expert

Why don't you send them, or rather the president of the company an email and ask him why they were trying to hack data from mindat and inform him that the effort nearly crashed the site and invite him to send some money our way.

23rd Sep 2011 08:34 UTCJolyon Ralph Founder

I have already passed on the information to the network abuse team at Statoil and it's now up to them to investigate and take action internally. Their own firewall logs should be able to identify where this came from within their organization.

23rd Sep 2011 10:39 UTCMarcus Voigt

There are probably many other companies .........


so much valuable information !


Why make a donation to Mindat, if the information can be stolen?


In the end, nobody carries the responsibility for it.


Homo hominis Lupus

23rd Sep 2011 11:45 UTCDavid Bernstein Expert

Isn't that "homini" Marcus? Regardless, a fine expression to use.

23rd Sep 2011 12:46 UTCVandall Thomas King Manager

Why not send them a bill? Disruption of a day's service should be worth 5000 Euros.

23rd Sep 2011 19:21 UTCAlf Olav Larsen

I am a Statoil employee, and noticed this morning that access to Mindat was forbidden through my job computer. Now I understand why. I am terribly sorry that someone in the company has hacked the site. Hopefully it will never happen again.


Regards,

Alf Olav Larsen

23rd Sep 2011 23:40 UTCJolyon Ralph Founder

Alf, very sorry you were inconvenienced by this problem - I'm waiting to hear back from Statoil's network people - once they have assured me the problem has been dealt with then access to the statoil network will be restored.


Jolyon

30th Sep 2011 17:28 UTCLloyd Llewellyn Expert

It's very surprising to me that anyone at Statoil has any time to do this - they should normally all be too busy following procedures and management systems! ;)

1st Oct 2011 00:44 UTCDebbie Woolf Manager

Is this the reason why I'm finding mindat slow to respond these past few nights ?

1st Oct 2011 02:48 UTCDouglas Merson 🌟 Expert

Here in the Pacific Northwest it was extremely slow until 1500 when it died. Back and not as slow as earlier in the day but not as fast as on a normal day.


Doug

1st Oct 2011 05:28 UTCCorie Mattar

Someone actually wrote this script to do exactly what it did.

And they're using IE 5.0??

Where can I send my resume to these people?

Obviously they need someone in their tech department from this century! >:D<


Corie

1st Oct 2011 09:15 UTCJolyon Ralph Founder

the IE5.0 is a fake string designed to hide they are using a robot to grab stuff. Just not hiding it very well.

1st Oct 2011 10:55 UTCJolyon Ralph Founder

I didn't hear back from Statoil at all.

2nd Oct 2011 00:01 UTCVandall Thomas King Manager

As Statoil has been formally notified and there is still recurring denial of service due to running scripts, then their failure to respond indicates at least an unconcern if not a more pernicious attitude. I still suggest that a bill should be sent to Statoil for actions now tolerated by their management. Maybe 5,000 Euoros/day is not enough?

2nd Oct 2011 10:46 UTCJolyon Ralph Founder

The script at statoil stopped running not long after the ban was put in place.


Jolyon

2nd Oct 2011 15:04 UTCSpencer Ivan Mather

I agree with Van King, send Statoil a big bill, that should stop whoever it is!

2nd Oct 2011 15:32 UTCDavid Bernstein Expert

It may be an obvious point but without substantiation of damages in place behind a bill of any amount, such a "delivery" would be laughed at. Just sayin' in the event Van's idea gains traction.

2nd Oct 2011 23:35 UTCDaniel Levesque

I'd hope the appropriate measures (ban) would remain in place if there was no response from Statoil's IT staff. Obviously they have an internal issue to deal with:

From "Statoil Ethics- Code of Conduct- version 5"
"4.9 ...Any downloading, storing or disseminating in breach of any copyright law or provision is prohibited."


Sounds like they have a rotten apple in the bunch!!!

3rd Oct 2011 00:02 UTCTony Albini

Jolyon,


For the past two days, I cannot look at the Today's Mineral Photos. I keep getting a prompt to Register which I have been for a while. Even when I follow the site's prompt, I cannot get in to look at the photos which are so informing. I hope this issue is related to your emails.


Regards,


Tony Albini

3rd Oct 2011 01:18 UTCModris Baum 🌟 Expert

Tony - you have to log in as well. According to the Member Directory you last "visited" (i.e. logged in) on Feb 10, 2010)

3rd Oct 2011 02:22 UTCRock Currier Expert

There are still times when Mindat is very slow, and last night there were times when Google chrome could not locate the website at all. Again!

3rd Oct 2011 11:18 UTCDebbie Woolf Manager

I got this message using chrome the other night "Fatal Error - Unable to connect to database."


(:P)

3rd Oct 2011 15:28 UTCVandall Thomas King Manager

The real purpose to sending a bill to Statoil is not to get money, but to get their attention. A bill sent to the accounting department and to the president should receive some notice. From the various messages, it is not always clear that the Statoil script remains the only problem. Is it a coincidence or is it the same problem?

3rd Oct 2011 15:32 UTCJolyon Ralph Founder

The statoil script stopped running shortly after I banned them. Statoil are not causing any direct problems to mindat currently

10th Oct 2011 19:35 UTCRick Dalrymple Expert

I more often than not have a problem getting on Mindat. I get the "Fatal Error-Unable to Connect to Database" a lot. Sometimes man times a day.


I am also getting the You must login to view these pages" which is ok but then I have to log out to go to a different page and then log in again.


I just thought it was my computer/lines/modem.

27th Dec 2012 16:24 UTCJolyon Ralph Founder

Statoil are back to their bad old tricks and trying again to steal content from mindat with bots.


I have had to block them again.


Jolyon

27th Dec 2012 17:31 UTCDean Allum Expert

Jolyon,

This problem with Statoil appears to be clearly in contradiction to their stated policy shown below. The mindat website audience would normally be one of Statoil's staunchest public supporters, so their actions are mystifying.


Statoil Ethics Code of Conduct Version 2:

"4.9 Information and IT systems

The individual’s use of information, IT systems and,in particular, internet services must be based on the

needs of the business and not by personal interests.

Information produced and stored on Statoil’s IT systems is regarded as the Group’s property.

Statoil therefore reserves the right to access all such information except where limited by law or

agreement. The individual is responsible for maintaining electronic files and archives in an orderly manner.

Private use is only permitted to a limited extent. Information that may be considered illegal, offensive

or inappropriate must not be processed, downloaded, stored or disseminated. Any downloading, storing

or disseminating in breach of any copyright law or provision is prohibited.
Any use of software in breach

of any copyright law or provision is prohibited."

27th Dec 2012 23:46 UTCKeith Compton 🌟 Manager

Hi J


Perhaps a more permanent ban is required


Cheers

28th Dec 2012 04:53 UTCJenna Mast

I guess someone at statoil really wants the entire mindat database for Christmas. I can relate. I often worry "What if someday Mindat should be no more? Then how will I identify my mineral specimens?" May that day never come.

28th Dec 2012 09:56 UTCChris Mavris Manager

If they keep acting like this, I would consider a legal action.

28th Dec 2012 13:26 UTCDavid DeCourcey

Rather than banning them or taking legal action, ask them to start sponsering a few pages.

28th Dec 2012 14:50 UTCReiner Mielke Expert

Hello David,


Why should they sponsor a few pages? You are assuming they have a conscience, which has not been thus far demonstrated.

28th Dec 2012 16:00 UTCClosed Account 🌟

Why just a few? I'd say they sponsor every page they've downloaded (that is not already sponsored). That would make life easier for Jolyon...

28th Dec 2012 16:20 UTCDavid Von Bargen Manager

Well, it probably isn't anything that Statoil is officially doing. Probably just a bored employee. If I was on their IT staff, I sure wouldn't want someone loading a spider bot on my network.

31st Dec 2012 19:41 UTCAaron Cross

Didn't you have a big problem with them earlier??
 
矿物 and/or 产地  
Mindat Discussions Facebook Logo Instagram Logo Discord Logo
版权所有© mindat.org1993年至2024年,除了规定的地方。 Mindat.org全赖于全球数千个以上成员和支持者们的参与。
隐私政策 - 条款和条款细则 - 联络我们 - Report a bug/vulnerability Current server date and time: 2024.3.28 15:32:08
Go to top of page