Its C# actually.StreetLights wrote:Me looking at your VB code is like you looking at my complex FLP files
The forum has been archived
While the forum may not be active, the community still lives on Discord! Click here to join us.
While the forum may not be active, the community still lives on Discord! Click here to join us.
How Long Does It Take To Extract All Posts From Omb?
- Sebastian Lawe
- Moderator
- Posts: 2534
- Joined: October 17th, 2012, 7:58 am
- Design Competitions Voted: 0
- Contact:
- ThatOneFox
- Moderator
- Posts: 17612
- Joined: January 20th, 2013, 5:53 pm
- Design Competitions Voted: 1
- Contact:
- Sebastian Lawe
- Moderator
- Posts: 2534
- Joined: October 17th, 2012, 7:58 am
- Design Competitions Voted: 0
- Contact:
- ThatOneFox
- Moderator
- Posts: 17612
- Joined: January 20th, 2013, 5:53 pm
- Design Competitions Voted: 1
- Contact:
- Sebastian Lawe
- Moderator
- Posts: 2534
- Joined: October 17th, 2012, 7:58 am
- Design Competitions Voted: 0
- Contact:
So guess what! The stats generator is working flawlessly on its new parsing engine (its much more accurate). Whats a parsing engine? A parsing engine essentially looks at data, converts it to a usable format, and makes decisions based on said data.
Lets just say, this parsing engine will allow me to easily start grabbing data from any website.
I can't wait to run the stats generator with two new stats. Who uses the most quotes, and who uses quotes a high percentage of the time.
I eventually hope to grab the time stamps of posts as well (that way some stats can only be assigned to active users).
Edit:
As of right now, OMB is 10.1mb of plain text. That's not including pictures at all!
Lets just say, this parsing engine will allow me to easily start grabbing data from any website.
I can't wait to run the stats generator with two new stats. Who uses the most quotes, and who uses quotes a high percentage of the time.
I eventually hope to grab the time stamps of posts as well (that way some stats can only be assigned to active users).
Edit:
As of right now, OMB is 10.1mb of plain text. That's not including pictures at all!
- Sebastian Lawe
- Moderator
- Posts: 2534
- Joined: October 17th, 2012, 7:58 am
- Design Competitions Voted: 0
- Contact:
- Phantomboy
- Moderator
- Posts: 5417
- Joined: October 9th, 2012, 11:04 am
- Sebastian Lawe
- Moderator
- Posts: 2534
- Joined: October 17th, 2012, 7:58 am
- Design Competitions Voted: 0
- Contact:
Yup, the issue was resolved. I was accidentally loading thousands of avatar photo's into memory (always a bad idea). The stats run fine now.Phantomboy wrote:Sebastian, I remember that you were having issues with memory consumption. Where you able to correct that someway? I remember you were saying that you were going to have it look at the post date or something so that it would only catch new posts - Did I remember that correctly?