4E Item Parser

[kevininrussia]

Are there any tools available to parse "Companions & Familiars"?

[Griogre]

Nice find Trenloe. Man, I wish I'd noticed that when I played 4E. :p

[valeros]

Posted new version with a fix for flavor text. Sorry, I never noticed it did not work (and if someone mentioned it, I must have missed it.) If other simple items like this occur, please post and I will try to fix. Thanks

(Also, please note that you do not have to download all the entries again to use the new parser. Use the *.txt file(s) that were generated to parse the data again without waiting to download entries.)

[lacan]

I just started using this today. This seems like it's going to be awesome.

I'm sure this will the first of many questions, but where are the .txt files created within the folder structure. I'm scraping now, but I don't even see the temporary files? Also, will FGPEMUtility.exe still be needed in the latest version? I can't seem find a download of it anywhere.

[corerupt]

This tool is a huge time save so thanks for your hard work.

I have a question about how the parser formats the entries and how Fantasy Grounds formats entries too. Take Character powers for instance. When viewing a power parsed using the tool it is all neat and tidy to read when opened within the module. When you drag the pin and drop it onto the players power tab and then view the spell the nice formatting is gone and all the text is jumbled (but still functional).

Is there an extension or something i am missing in order for the formatting your tool provides to look the same in fantasy grounds when i import a power from a module to a character sheet?

[valeros]

where are the .txt files created within the folder structure?
Both the mod file and the txt file should be in the same directory as the parser executable when the parsing is complete.


will FGPEMUtility.exe still be needed in the latest version?
No.

[valeros]

This tool is a huge time save so thanks for your hard work.

I have a question about how the parser formats the entries and how Fantasy Grounds formats entries too. Take Character powers for instance. When viewing a power parsed using the tool it is all neat and tidy to read when opened within the module. When you drag the pin and drop it onto the players power tab and then view the spell the nice formatting is gone and all the text is jumbled (but still functional).

Is there an extension or something i am missing in order for the formatting your tool provides to look the same in fantasy grounds when i import a power from a module to a character sheet?

I am surprised no one mentioned this before (unless it was another case of me not noticing when someone did mention it!)

So the reason for the difference is that one is looking at the "description" field which allows tables and formatting (such as bold, italic, etc.) and the other is looking at the "shortdescription" field which does not allow tables or formatting. However, I have posted a new version of the parser that tries to simulate some of the formatting. So now the powers look much better from the character sheet. (At least the ones I checked anyway.) Remember, use the existing txt file to parse. Do not waste time downloading everything again.

Also, any powers already copied to a character sheet will have to be deleted and replaced. Just updating the module will not update the character sheet.

Not sure if this will break anything else. Let me know if it does.

Thanks

[corerupt]

Had to re-parse all 9300 powers as i accidentally deleted my lists last night lol.

Anyway the current version on the parser absolutely fixes the issue i mentioned and the powers are now all neat and tidy when pulled from the module to the character sheet power tab :) .

Can't thank you enough, you are awesome!

[corerupt]

Not trying to be a pain but i have another annoyance of mine that you may be able to do something about. :p

I made a feats module and unlike the powers module it does not copy the information over from the module to the character sheet. All is fine while the module is open (feats are readable from the sheet) but when you close the module you can no longer see the details of the feat from the sheet, it just says the source is not available. I'm guessing this a FG issue?

Not huge just thought I'd mention it :D

[Trenloe]

I'm guessing this a FG issue?
Yes, FG just records the link to the module.

If you "really" want the text to be available then create a new, blank feat in the character sheet and manually copy/paste the text into the new feat. This will ensure that the data is stored with the character sheet and doesn't rely on module data.

[corerupt]

Yes, FG just records the link to the module.

If you "really" want the text to be available then create a new, blank feat in the character sheet and manually copy/paste the text into the new feat. This will ensure that the data is stored with the character sheet and doesn't rely on module data.

Yeah, that's what i have been doing. Can't have it all i suppose :p. Cheers for the info.

[David32780]

It is saying we were unable to find an account with that username and/or password.

Is this parser currently not working? I have tried this on and off all day and I am getting the same pop up. When my account it good and active.

Thanks

[David32780]

Is there a tutorial video on the start to finish process also?

[damned]

Hi David32780 try logging into DDI with your browser before launching the Parser...

[David32780]

I am logged in on another browser.
I think the Parser is out dated possibly? It is asking for an email and Wotc has converted away from that.

[David32780]

It is working now, showing each monster card one by one. Now do all of these go into a folder automatically now called monsters seeing I named it that?

[damned]

Hi David - you will see quite a few posts like this one: https://www.fantasygrounds.com/forums/showthread.php?17485-4E-Item-Parser&p=193820&viewfull=1#post193820
You just log into DDI first in browser.

[damned]

Ahhh good - you got that. I know it wll take a while but I would read back a few pages and you will see the answer to most of your questions.

[David32780]

I got the 3 folders I made for the PHB, Monsters and DM stuff. I kept everything in the 4e parser folder and there are some other text and movie document files in the main 4e parser folder.

I tried to find the location to put these modules into and I had no luck finding anything in the Phantasy Grounds folder.

I also looked at the OP at the beginning of the thread and didnt see where to put this stuff either.

Sorry, this kind of technical stuff is not my forte.

Thanks in advance

[Griogre]

The "movie" files in the parser's folder are probably your modules. Right click on them, select properties and check to see if they are .mod files. If they are, you will want to put them in the modules folder in FG's data app folder. This folder is hidden by the operating system by default (I'm assuming a Windows box). To find the folder start FG. In the launcher in the top right above the version number is a file folder button. If you hover your mouse over it you should see a tool tip that says "Open Data Folder". Click this button and you should see Windows Explorer open with a list of folders. One of them should be "modules". Copy and paste your .mod files into this folder. Then go ahead and create or load a 4E campaign.

When the campaign loads, click the Library button on the bottom right of the FG desktop. When the Library window pops up, click the "Modules" button at the bottom left which will cause the "Data Module Activation" to open. You need to activate your module here by double clicking on the icon to the left of the module's name. Note some 4E modules are very large and it will take a few seconds to open and activate. If you get impatient, you can double click to open the module and when nothing seems to happen double click again so you module will open and then close. :p You can tell if you opened the module if the book icon to the right of the module's name opens.

[lokisweapon]

For some reason DDI won't let me sign in through the parser using my email. And the only way I can sign in online is by using my screen name, not my email address. Any ideas why this might be happening? I can't parse and download because I can't login even though I'm a DDI subscriber.

[damned]

Hi Lokisweapon - welcome. Have you read the thread? Or even the last page? The answers are all there :)

[lokisweapon]

Awesome, thanks damned, but now I can't get it to load as a module. I have an xml file called "db" what should I do with that?

[Trenloe]

Within the same directory as 4eParser.exe you should have one (or more) files that have a .mod extension. Windows might show it as a video file - but it's not a video file it's a module file (this is just windows configured to recognise .mod as a video).

Copy the .mod files to <FG App data>\modules then launch your 4E campaign and go to the library -> modules section to activate your shiy new library modules.

[lokisweapon]

So I did that, there were 4 files total, two xml files and a png file (the thumbnail), and then a .mod file. I took the .mod file and placed it in the modules portion of the appdata. I then opened a 4e campaign and went to the library. I clicked modules and all I see are the default ones. Mine is nowhere to be found.

[Trenloe]

So I did that, there were 4 files total, two xml files and a png file (the thumbnail), and then a .mod file. I took the .mod file and placed it in the modules portion of the appdata. I then opened a 4e campaign and went to the library. I clicked modules and all I see are the default ones. Mine is nowhere to be found.
Restart FG and try again. Sorry if you've already done that... I can't think why this wouldn't work - I just copy the .mod file to the \modules directory, run a 4E campaign and it is there to select.

One thing to try is open the console window before you go to the library (type /console in the chat window). This might give some warnings about possible issues with the module.

[Pedro]

Short answer, no.

Sorting items by level would require another index (meaning writing more code.) My thought for my parser was not to be a substitute for the compendium, but just to save the time typing the entries into FG. I always assumed I would use the compendium, the module, the rulebook, etc. to find what I wanted. I just did not want to have to type it into FG once I knew what I wanted. If FG had more options for sorting built into the windows, that would make it mush easier. But right now, each sort requires an index (at least in the 4E ruleset.)

Hello,

Is there any chance to make a sorting items by the level?

Thanks for answer.

[kevininrussia]

Is there a parser program that will download the .monster files from DDI Monster Builder?

[valeros]

Is there any chance to make a sorting items by the level?
Updated to add a "By Level" index on items.


Is there a parser program that will download the .monster files from DDI Monster Builder?
I do not know of one, but a partial solution is to use my old .monster File Converter. Not sure if it still works and it was never perfect.
https://www.fantasygrounds.com/forums/showthread.php?17679

[kevininrussia]

Updated to add a "By Level" index on items.


I do not know of one, but a partial solution is to use my old .monster File Converter. Not sure if it still works and it was never perfect.
https://www.fantasygrounds.com/forums/showthread.php?17679

Thanks Valeros, I will give it a go.

Are there any tools available to load, edit and save .monster files besides Monster Builder? Loading .monster files saved from the Silverlight online Monster Builder crashes the older offline Monster Builder...

[Shardxi]

So as of Aug 31 i can not seem to log into DDI via parser, i've logging in first with IE, tryed everything but it still says my login is no good. any fixes?

[Shardxi]

Never mind i found out how to log in via parser window.

[Weepdrag]

I subscribed to DDI and the parser won't accept my login, either by username or email address and I tried both the parser window and in the window below it when it fails. I verified the login on the DDI website and all of the DDI content works on their site. If anyone has the magic word to make the parser happy I would greatly appreciate it.
Thanks in advance

Update
Sorry. Head/desk I didn't see the part about using Internet Explorer ONLY. I'm a devout Firefox user and don't remember what Internet Explorer looks like.

Update #2
Finally got past the DDI login by having the program set for 2 browsers and now all I get is "NO Entries Found"

Update #3
The "NO Entries Found" Message continues. I tried it with the "other" 4e Parser program and it returns a "500 server Error" from the DDI servers. Has anyone been able to successfully scrape the DDI servers in the past few days?

[Weepdrag]

Anybody out there?, anybody?, crickets?? Has anyone had a successful scrape of the DDI in the past week?

[valeros]

I do not have my subscription anymore, but I have a few recommendations:

Before you do anything, login to DDI from the "SignIn" button in the browser that is part of the tool. If it will not let you login from there, that is a problem.
11036

Then start at Step 1 of the GUI. I recommend you only use one browser. You will be able to see it working at the bottom. If not, then there is a problem. If it asks you for your username/password once you start to download, that apparently does not work for newer accounts. But that is why you need to login before that.

Also, what entries are you trying to download (i.e., what option did you use in Step 1)? I recommend picking something small to start with if you are having trouble (i.e., something that does not return hundreds or thousands of entries, but less than 50 entries.)

[Weepdrag]

Hi Valeros, thanks for the reply. I've tried to download a single file in step 1 with the same result. My login only seems to work if I set the app for 2 browsers and have Internet Explorer open and logged in to DDI otherwise it comes up as invalid login. I tried to use Parse4E and received a 500 server error back from DDI. I've tried multiple installations on a couple of different computers with same results. The app pulls all of the categories and entries, then on step 4 returns "no entries". I'm just wondering if WotC made a change this month to block parsing. I just don't want to pay another month if this is a no go.

Thanks for the reply

[damned]

I wonder if the DDI stuff is being affected by this stuff?
https://www.fantasygrounds.com/forums/showthread.php?26062-WotC-closing-forums

[Weepdrag]

Thanks Damned, maybe the DDI is dead for our purposes, hopefully someone else will be able to confirm or debunk whether it is before my subscription ends.

[damned]

I no longer have an account to test with - in fact I havent used this parser in a long time... sorry....

[David32780]

When I parsed the 4e stuff several months back i had major connection issues trying to connect and finally did connect. Hearing this I am glad I did it then and did not wait.

[kaustix]

I tested it this morning and it worked... not at first, but here is what I did:
Close all browsers
Open Internet Explorer (ONLY)
In IE (I used 11) Navigate to D&D Insider
(If you use Windows 10, open the Real Internet Explorer Desktop Application, Not Edge Browser)
Login to D&D Insider
Navigate to Compendium and leave IE on this screen

Open the Parser Software
In the Bottom of the Parser Application, use the integrated browser & Also login to D&D Insider from this sub-Window
Select your Step1 Book...
follow directions normally and it worked for me on both the DM & Players.

[Weepdrag]

Thanx Kaustix,
I went through the same procedure until my DDI subscription expired back on 9/10 and just got empty downloads. Maybe I'll try it again at some point but I'm not currently doing any 4e games so no rush.

thanks again

[damned]

thanks for posting that kaustix!
good work.

[Pedro]

Hello,

I found a problem with the number of items displayed in the parser. Today I tried to download a whole database with all items and parser showed that there were only ~ 3.7k. Six months ago I downloaded the same base of items then it was ~ 10k. I logged directly to https://www.wizards.com/dndinsider/compendium/database.aspx and it turned out that in fact the number of items is only ~ 3.7k.
Does anybody know what happened or maybe I'm doing something wrong ?

Thanks.

[Pedro]

Does anyone know why in the compendium is only 3.7k items? Half a year ago I downloaded the entire database of items and there were 10k.

[Griogre]

I don't have a DDI account any more, but I would look and see if they consolidated the item descriptions, ie instead of having +1 magic weapon, +2 magic weapon, ..., +5 magic weapon they just have one "magic weapon" entry. Most items other than the wondrous had multiple entries for different pluses and levels. It's the only thing I can think of that would give you that type of reduction other than WotC hosing the data.

[valeros]

Last time I had an DDI subscription, there were 3,752 item entries (meaning the category of "Items"). The parser breaks these 3,752 item entries into 10,534 individual items for FG since each Item entry can represent multiple individual items (just as Griogre mentions.)

[Pedro]

Valeros and Griogre you are right, I forgot all about it. In that case, problem solved.

[Cebby]

DnD Insider is not accenting new subs, so if you dont have one your SOL. Any work around to get this content, or would someone pm a share?

[damned]

Sorry Cebby no sharing of copyright stuff here please...

[johntjamesonjr]

sounds like a great program.. only problem is i dont have a DDI subscription anymore.. could it possibly work with the pdfs that i have? or i could just try it n see.. idk.. anyway i might just DL it n see if it works thanks.

[Apolala]

If you got an account I do not believe you need a sub anymore. Try logging in at ddi.wizards.com

[amrbean]

Not to beat a dead horse but....

I can't login to my DDI account through the parser.

I downloaded the latest copy but I still have an issue signing in. I tried the trick of logging into the compendium on IE (not Edge, Chrome, etc.) first and leaving that open. In IE can can access the compendium via IE using my DDI account (using my user name, not my email), but for some reason I still cannot access it in the parser. Is it possible the Wizards moved the login site around? Otherwise, I am not sure what I am doing wrong. I even had a friend try.

A few other questions if you don't mind, as I am trying to get up and running for a game with friends and quite frankly I don't know what I am doing:
1.) After I parse and put the .mod files in the directory, do my Players need to do the same?
2.) Do I want to do both the DM and the PC sets? I assume I need to do them separately?

Thanks!

[Griogre]

My impression is Wizard's is setting up the ground work to shut down DDI, so its quite likely they have revamped things enough to cause the parser to not work.

1) If the player's have local copies you don't have to transfer the data to them when they are connected and they can use them when not connected to your server.

2) The 4E module files can get very large. You probably want to split them so you don't have to have everything open even if you aren't using that data. A natural divide is Player stuff and DM stuff and you can further split the DM stuff into Monsters and Items.

[amrbean]

Thanks for answering those questions. I really appreciate that.

Urgh, so this is annoying. Essentially now my friends and I can't play 4e.

[ddavison]

One thing to consider is that since the DDI Compendium info is free, you can just copy and paste info as you need it for individual powers or for monster abilities. FG does a pretty good job of recognizing those and then parsing the abilities with the built-in parsing options.

[amrbean]

I guess. For a big campaign that could take a long time. I think it's easier for us to just move to 5e.

[jaelwyd]

Not to beat a dead horse but....

I can't login to my DDI account through the parser.

I downloaded the latest copy but I still have an issue signing in. I tried the trick of logging into the compendium on IE (not Edge, Chrome, etc.) first and leaving that open. In IE can can access the compendium via IE using my DDI account (using my user name, not my email), but for some reason I still cannot access it in the parser. Is it possible the Wizards moved the login site around? Otherwise, I am not sure what I am doing wrong. I even had a friend try.

Thanks!

I am having the same issue. I wonder if it is possible to recode the parser so the parser browser points to the new login area? I am not a programmer so I have no idea if that would work or not.

[damned]

Do you have a valid subscription and not just a DDI account?

[jaelwyd]

Do you have a valid subscription and not just a DDI account?

I should. I gave WOTC money for it:D

[damned]

Then login using your browser first and confirm its working. Leave the browser logged in and retry. That *used* to work.

[jaelwyd]

Nope. The in parser browser is stuck on the Wizards home page and when you click the link for the DDI tools it opens an external browser. Seems like it be a simple fix in the program, but there doesn't seem to be a lot of interest in 4e anymore

[valeros]

I updated the application to start at "https://ddi.wizards.com/" and force the Compendium to not open a new window. You can see if that will work.

[jaelwyd]

I updated the application to start at "https://ddi.wizards.com/" and force the Compendium to not open a new window. You can see if that will work.

Like a charm! Thanks!

[valeros]

Updated with fix for "Database node type mismatch" error due to "locked" field. Caused problems with adding monsters to combat manager.

[alexandyr]

Just wanted to chime in with a huge THANK YOU for creating this tool. It has been very sad to see 4e get so close to being a robust electronic ruleset(still probably the best character builder out there for a system this complex!) only to fail commercially and be cast aside. With at least one long running campaign that I plan to continue I am hoping that this tool can extend 4e's lifetime for my group even once Wizards shuts down the ddi tools

I've successfully imported everything and am astounded by how well most things are working inside FG.

Having said that, I have run into one odd problem - it does not seem that you can drag Race and Class into their respective spots on the character sheet in FG? Is the intent to just put them into Abilities for reference and manually calculate HP, etc or am I missing something?

Thanks!

[jaelwyd]

I don't think the 4e ruleset is built that way because of there is no official 4e material for FG. And 4e had a closed license so no third party either. 5e has both so I assume that's why it works there.

[damned]

Its not so much because of the license. Only the one ruleset (the newest and shiniest ruleset) has all those features.

[geewaagh]

Did anyone ever figure out how to parse just Essentials material. The source list is truncated in the parser for me so I can not pick through the right material. Looks like "All rules books" is my only option.

[valeros]

Did anyone ever figure out how to parse just Essentials material. The source list is truncated in the parser for me so I can not pick through the right material. Looks like "All rules books" is my only option.

So I never added an option to sort by books, but you can fix the menu. There is a button on the right in Step 2. So select "Select Compendium Entries" in Step 1. Wait for the browser at the bottom to complete loading the Compendium. Then click on the "Add All Books to Source" button on the right side in Step 2. Then the Source menu will have all the books when you pick a category (such as Powers or Classes.) (You may have to click the button again once a particular category has been selected.)

It is still a little painful as for example for Powers, you would have to pick a source such as Heroes of the Fallen Lands and select "Add Entries" in step 2, then pick the next book and select "Add Entries" again, and repeat until each Essentials book is added.

13734

[valeros]

Did anyone ever figure out how to parse just Essentials material. The source list is truncated in the parser for me so I can not pick through the right material. Looks like "All rules books" is my only option.

I just created another option because this is something I wanted as well but I cannot use the Compendium anymore.

You can now filter the entries to specific books (e.g., to create an Essentials only library) by creating a file named "Valid Sources.txt" in the same directory as the parser. All the valid sources from all entries are listed in "All Valid Sources.txt". Copy that and remove what you do not want. Only entries that match with one of the sources you list will make it into the final module. So if you want Essentials only, then list only the books/sources you consider "Essentials". Then parse all entries and only the ones matching those sources will appear in the module. Probably best use from a saved file that already has all the entries rather than downloading all entries again.

When you run the parser it should list how many entries pass the filter. For example:
25408 Total Entries
32190 Total Resulting Parsed Entries
Filtering
3026 Total Resulting Filtered Parsed Entries

[damned]

valeros your tools are amazing - thank you for making and maintaining them!

[geewaagh]

Valeros,

Fantastic! Thank you. Its been a VERY busy week, sorry for the delayed response.

[comicspop]

Hi there, new to FG.

This all looks amazing, but am I correct in assuming that there's no way to download and parse the material without having a current DD Insider subscription? I have the free account, but it looks like I'm truly out of luck, eh? When I click "Download and Parse" all it does is tell me when the DL started, no progress. It also asks me to log into DDI with my email instead of my username.

Any options?

Thanks for your time, I do appreciate it.

EDIT: I should say that I own a bunch of the books and was looking into how to do that most effectively, and I stumbled on this thread. If there's no fix for the parser, would you guys have an idea where to start for manual entry (besides with a huge pot of coffee)?

[Moon Wizard]

It requires a DDI subscription, since the data is copyrighted.

If you decide to do manual entry, I would just enter the powers as you need them.

In fact, that's how I suggest handling all data entry for campaigns. Just enter what you need, and don't sweat the rest.

Cheers,
JPG

[Samop]

It requires a DDI subscription, since the data is copyrighted.

If you decide to do manual entry, I would just enter the powers as you need them.

In fact, that's how I suggest handling all data entry for campaigns. Just enter what you need, and don't sweat the rest.

Cheers,
JPG

How could I get a DDI subscription? everytime I want to join it took me to a critical error

[Moon Wizard]

I have no idea. I haven't had a DDI subscription, since 5E came out. You'll have to ask Wizards of the Coast support team.

Regards,
JPG

[midas]

Does it take you to an error when you check out? Or just trying to click a link somewhere to start the process?

**EDIT** Never mind, I see that the subscription link (https://dnd.wizards.com/go/insider/subscription) is no longer an active link. That's the only place I ever saw to start a subscription.

You could try contacting them via https://wizards.custhelp.com/app/answers/detail/a_id/2297/ to see if they'd be willing to take your $71 or whatever it was for a year subscription, but YMMV.

[jaelwyd]

They may have stopped taking subscriptions. I have heard others not being able to. I could be very wrong though

[Samop]

So there is no way to make it works?

[Samop]

I'm asking wizards, but after your reply jaelwyd, I think it would be useless. Is there a way that someone who have the modules and the information could share it?

[Moon Wizard]

Technically, that's a violation of copyright laws. We don't condone or allow trading of copyrighted data on our forums.

Regards,
JPG

[damned]

At this stage the Wizards have no interest in re-opening DDI. Even though they have no interest in selling this it is still their IP so it cant be shared. Just enter the data you need when you need it. You will only ever use less than 1% of 1% of the stuff that was on DDI.

[comicspop]

Hey guys,

I reached out to Wizards via their support email system and got a great response.

Long story short, I bought a month subscription to DDI.

[damned]

Well done comicspop.
You cant post links until you get a few more posts under your belt :)

https://gc.digitalriver.com/store/dndi/html/pbPage.wizards

[comicspop]

Thanks! :D

[Samop]

Great! I got the same answer and got today the subscription, but I'm still unable to login via DDI Parser...any detail I'm missing?

[damned]

Hi Samop you are going to have to read the thread! I think you will need to login via your browser and then run the parser - from memory...

[Samop]

I havem't read all the pages, but I read at least that and I did it and again, after your answer, is there any video tutorial? I'm really stuck with this...
This is what I do:
Step 1 - I press on add player entries
Step 2 - nothing
Step 3 - nothing
Step 5 - I let the client.xml tick
Step 6 - I enter my email and password
Step 7 - Press on "download and parse selected entries"
But it says Username and password don't match, I have tried with either email and username. Then it appears again in the in parser browser two bars with the username and password.

[Samop]

I think it's working!!!, I get to the DDI log in page in the in parser browser and then it worked, now is downloading... I will comment later. Thank you!

[damned]

I think it's working!!!, I get to the DDI log in page in the in parser browser and then it worked, now is downloading... I will comment later. Thank you!

Thanks for the update. It would be worth posting your steps here for the next person :)

[computertrucker]

This was very helpful. i had to actually re subscribe (which cost a paid subscription) but my parser is actually running.. thanks for this!

[computertrucker]

Ok just parsed for 8 hours.. got to the Victorious Soul Feat. and it just stopped im not sure what happened. I am afraid to stop and restart? Does it save these to a file location?

[computertrucker]

So if it disconnects. do you have to start over from scratch???

[Chazz]

I really have no idea what I'm doing wrong... I've tried logging in using IE (both the 64-bit and the no-add-on version), Firefox, Chrome. I know for a fact my DDI subscription is working, yet no matter how I get it set up, the parser adds all the entries, then when I go to hit "download and parse" it can't log in. I looked through the thread, am I missing something? Is there some extra step I was supposed to take I just couldn't find?

[damned]

Chazz login through the parser app when it brings up the page.

[Chazz]

Chazz login through the parser app when it brings up the page.

I tried that, it keeps erroring and saying that that account can't be found, even when I straight copy and paste..

[damned]

When you login to the website via a normal browser can you see all the details?

Samop wrote


I havem't read all the pages, but I read at least that and I did it and again, after your answer, is there any video tutorial? I'm really stuck with this...
This is what I do:
Step 1 - I press on add player entries
Step 2 - nothing
Step 3 - nothing
Step 5 - I let the client.xml tick
Step 6 - I enter my email and password
Step 7 - Press on "download and parse selected entries"
But it says Username and password don't match, I have tried with either email and username. Then it appears again in the in parser browser two bars with the username and password.

and then


I think it's working!!!, I get to the DDI log in page in the in parser browser and then it worked, now is downloading... I will comment later. Thank you!

[jaelwyd]

I'm glad to hear that DDI subscriptions are still open. I find the character builder immensely helpful and fun to use.

[Chazz]

So... I have no idea what changed. But now the login page was showing IN the parser which it never had before, and it let me log in, and now it's working. HUZZA!

[spite]

Does this still work? I tried to use it today, but got stuck on asking for the login. It asks for a email and password, and using my account name + password doesn't work, nor does using the email address associated with that account name. I have an active subscription from the link in the OP but no joy so far. :(

[damned]

Hey spite - ya gonna have to read the last three pages or so of this thread...

[spite]

Yea I tried reopening, and going into it and logging in but it just wont accept it >.<
Time to sleep and cry as it works in the morning.
Thanks anyway though damned. I'm really just trying the "if I post it'll spontaneously work while waiting for someone to suggest a fix" method as I did for par5e.

[damned]

I dont have a login - I think you close all your browsers and then launch the parser and login via the parser?

[spite]

Ok so successfully downloaded and parsed the PHB (first option selected) and it won't open in FG. I get the "not enough memory" error. Is there an easy way to break it down to a couple of PHBs?

[spite]

I think this is related to 3.2.0, as I reverted to 3.1.7 and it works perfectly now. Will report this issue in the 3.2.0 thread.

[magnusprime27]

so I ran the parser, all went smooth, but
it seems it didn't grab tattoos, or dragonmrks?
can the parser be used on adv's like keep on the shadowfell, thunderspire labyrinth?

[midas]

If the information is in the DDI Compendium then it should parse it out.

[dingus420us]

I have a problem the parser will not let me sign into my Ddi account. Am I doing something wrong?

[damned]

I have a problem the parser will not let me sign into my Ddi account. Am I doing something wrong?

welcome dingus420us read the last three or four pages here fully.

[dingus420us]

Okay so I have tried working with the partner for the last week or so, but I've still had no luck with it. I have tried selected in trees from the compendium. On step 6 I have used two browsers and entered my D&D Insider account information, but still nothing. And at the very bottom when it ask to yeah we had a little time in that field it gives me the error that I do not have an account. Please somebody help me.

[spite]

Make sure you are logging in when you first open the parser, not when it asks you after you've already done the trees etc.
Otherwise can you post images of the errors you are getting and at what steps.

[dingus420us]

That got it! Thanks.

[valeros]

Modified parser to update GUI to make slightly easier to use with Compendium for new users since it seemed to be a problem. Also fixed various bugs with incorrectly parsing some entries (mainly some powers in paragon paths, classes, epic destinies, etc.)

If you get an error that "We were unable to find an account with that username and/or password", then you probably did not do Step 1 (i.e., login to DDI in the browser in the tool.)

[Fizban]

So I just renewed my DDI sub as I plan on running a 4th edition game soon. I found out that the DDI is no longer supported so I fancy getting the whole thing downloaded and archived for future use. Any idea how long that will take?

Alternatively, do we know if the parser will work with the following tool?

https://github.com/Sheep-y/trpg-dnd-4e-db

Thanks.

[valeros]

It will take 12+ hours. It will be comparable to the tool you mention. That is, 2-3 seconds per entry on average. The parser does not work with the tool you mention. However, once you have downloaded entries it does store the entries as a text file. One text file per time you download entries. Those files can then be used in the future instead of downloading the entries again. So basically it archives the data as well. I recommend not trying to download all the entries at once but to download a category at a time (e.g., all monsters, then all traps, etc.)

[Fizban]

Huh, I've filled out the form to make for this 'essentials' package and it's really taking it's time. I imagine it would not be faster than downloading 9000+ powers at once.

Anyone got the parsed data zipped up somewhere? Or would that constitute piracy? [REMOVED BY MOD]

[Trenloe]

Anyone got the parsed data zipped up somewhere? Or would that constitute piracy? <REMOVED>
Yes, this would breach copyright.

That's the point of this parser - it allows people with a DDI account to do a one-off scrape of the compendium themselves. No sharing of copyright data, just do it yourself. It might take a while, but it's a one-off scrape (as mentioned by valeros above). Patience required! :)

[spite]

Interesting that this is still managed. Is there any chance of there being a change to how feats are handled? Ever since 3.2.0 the feats are unable to be opened, even breaking them down to Heroic/Epic etc, Heroic causes issues for me and players.

[Fizban]

So next question, what ever happened to the functionality of parsing a pdf into the data? Pretty sure I was able to do that with the digital copies of the books that I have. Which made for easily managing modules along the normal FG method.

[valeros]

what ever happened to the functionality of parsing a pdf into the data

Personally, I was unaware of any such functionality for parsing 4E PDFs. (I had written something like that for 5E. But it only worked with the basic rules PDFs.)

[valeros]

I posted a new version of the parser to change the output "to a single data path location that matches other ruleset data paths" per https://www.fantasygrounds.com/forums/showthread.php?35460. If you notice any errors, please let me know. Thanks

[Fizban]

Hmm, I distinctly remember a tool that let me put my digital copies into FG. No matter, the compendium is doing fine, those digital copies are long gone, and the last time I play 4e was many years ago so I may just be imagining it lol. Another question though (sorry there may be a few of these). After downloading the compendium onto my PC, is there an easy way to filter through the 'creatures' list in order to only parse specific creatures from existing data. For instance, if one session called for only a few goblins encounters, could I filter through the data to parse just the required goblins, thus creating a module for one session (which would improve download times for the players and keep their caches low).

Thanks again.

[damned]

Hmm, I distinctly remember a tool that let me put my digital copies into FG. No matter, the compendium is doing fine, those digital copies are long gone, and the last time I play 4e was many years ago so I may just be imagining it lol. Another question though (sorry there may be a few of these). After downloading the compendium onto my PC, is there an easy way to filter through the 'creatures' list in order to only parse specific creatures from existing data. For instance, if one session called for only a few goblins encounters, could I filter through the data to parse just the required goblins, thus creating a module for one session (which would improve download times for the players and keep their caches low).

Thanks again.

Players dont cache anything that hasnt been hared with the,. If they dont fight a Gorgon they wont have the Gorgon in their cache.

[Fizban]

Ok cool. Does that mean that I can literally have everything from the compendium loaded up as a module and it won't affect load times?

[valeros]

Updated parser for fix for bug with new data paths. (Items were not listed if powers were also included in the module.)

[Trenloe]

Does that mean that I can literally have everything from the compendium loaded up as a module and it won't affect load times?
Won't effect player load times based of GM content not shared, yes.

[bestellen]

If the information is in the DDI Compendium then it should parse it out.

[twh]

I have a strange bug with the parser, everything works fine (well, it downloaded some of categories and it's working right now on bigger ones so fingers crossed), but not with every category. When I select Creatures or Feats in Compendium, click "Search", then click "Add entries to download", it shows the amount of entries there which I can then parse. But when I select "Companions & Familiars" then Search it shows entries in Compendium, but when I click "Add entries" it just says "0 Total Entries for Download & Parse". No amount of filtering it further helps.

I also can't help but notice that it's the only category with "&" in its name. Can it be a scraping bug ?

[valeros]

From description of tool on first entry:

All Compendium Entries but "Companions & Familiars", Artifacts, or Item Sets supported (but most items in Items Sets already listed separately.)

Tool does not parse those entries. Sorry

[spite]

Is it worth reparsing with the changes that weremade for 3,2,0? Or will existing modules work with the changes to libraries?

[Thane]

Greetings all!

Trying to get this 4e thing a go, and have parsed all material into module. I get this error on accessing powers though:

Ruleset Error: windowcontrol: Database type mismatch for control (flavor) in windowclass (power_stats)
Script Error: [string "power_stats"]:1: attempt to index global 'flavor' (a nil value)


Any ideas?

Thanks ahead of time

[valeros]

The problem as far as I can tell is that the update expects the flavor text to be a "formattedtext" field instead of a "string" field. I can change the parser for that, but not sure if that will break anything else. Also, I do not believe Powers are the only thing with flavor text, so not sure if that change affects other types now. I would think just Powers since the 3.2.2 update made a change to Powers and Feats, but I do not think Feats not have flavor text.

[Crossems]

I noticed the same thing, and was wondering if I would need to rerun the parser or do a find and replace in the files.

Never Mind...I was hoping to just do a find and replace on <flavor type="string"> to <flavor type="formattedtext"> in the db.xml and recompile the mod...but i see that's not how that works.

Overall though, I'm getting the error message now on all powers, but nothing else so far.

[Thane]

Also found it to be the case with Epic Destinies and Races.

[Crossems]

Found a manual work around.

1. copy the [Content_Types].xml from a parsed .mod file and place it into the same folder as your parsed files (db.xml, definitions.xml and thumbnail.png).
2. do a find and replace on the db.xml for <flavor type="string"> to <flavor type="formattedtext">.

NOTE: This will not work for Items and Rituals, those elements still require <flavor type="string">. I used notepad++ to edit my file, that way i can do a global find and replace, and then select the Items and Rituals elements and return the flovor element to <flavor type="string">

3. zip all the files into a new zip.
4. rename the .zip file to .mod file and copy it into your FG Modules folder.
5. restart FG, and all parts should now work.

So far I've verified: Backgrounds, Diseases, Epic Destinies, Feats, Items, Monsters, Poisons, Paragon Paths, Powers, Rituals, Terrain and Traps all working with this method.

[DGM]

Thanks for the info it seems that this will be fixed in the 3.2.4 release of fantasy grounds.

"[4E] Flavor text data error when viewing powers depending on parser used. Changed to use string data type, and to load either. Only string data can be edited."

[Thane]

Thanks for the info it seems that this will be fixed in the 3.2.4 release of fantasy grounds.

"[4E] Flavor text data error when viewing powers depending on parser used. Changed to use string data type, and to load either. Only string data can be edited."

Excellent!

[DGM]

So quick question, can this parser also parse the monsters with tokens?

[valeros]

So quick question, can this parser also parse the monsters with tokens?

Yes and no, as I am not sure exactly what you mean.

So when the parser runs, it leaves an output folder as well as the ".mod" file. In that folder, create a "tokens" folder. Under that folder, create a folder named the same as the module. (Not sure why I did that, I should change that in a future version.) If you then put PNG tokens named the same as the monster in all lower case and ending in ".png", then the tokens should associate with the monster.

So for example, I create a module named "Monster Vault". Then in the folder called "Monster Vault" that is left by the parser, I create a directory called "tokens" and under that a directory called "Monster Vault" and under that a token named "orc archer.png". Then I zip it all back up (from inside the top "Monster Vault" directory), rename the zip file to "Monster Vault.mod", and drop it in the "modules" folder in Fantasy Grounds. When I then open that module, the "Orc Archer" monster will have that token already associated with it.

Is that what you are asking? If not, what tokens?

It would be nice if this parser automatically linked to the tokens that can be purchased for Fantasy Grounds (i.e., D&D Tokens Volume 1 & 2), but those tokens only cover a few monsters and I do not have the info (module name and specific token names) to have the tool automatically associate them. Given a list of monster names to token names, I could setup an option to link automatically to the those tokens or Darkwoulfe's, Devin Night's. etc.

[DGM]

Awesome, that was what I was looking for.
I was dragging the monsters out of the module and then manually adding tokens and this was quite a hassle, now they are automatically linked from within the .mod file.

So much easier!
Thank you.

[crittman]

My add entries button is greyed out. What am I doing wrong

[damned]

Welcome crittman are you running any extensions? Are you player or GM? Can you post a screenshot?

[crittman]

I figured it out. I was not pressing the Navigate to Compendium but instead pressing compendium in the browser.

[crittman]

New problem I am having

Ruleset Error: windowcontrol: Database type mismatch for control (flavor) in windowclass (power_stats)
Script Error: [string "power_stats"]:1: attempt to index global 'flavor' (a nil value)

[Trenloe]

New problem I am having

Ruleset Error: windowcontrol: Database type mismatch for control (flavor) in windowclass (power_stats)
Script Error: [string "power_stats"]:1: attempt to index global 'flavor' (a nil value)
Discussed on the previous page of this very thread. Fixed in the upcoming v3.3 release of Fantasy Grounds.

[crittman]

Error when opening a weapon entry

Ruleset Error: windowcontrol: Database type mismatch for control (cost) in windowclass (item_stats_other)

[valeros]

Ruleset Error: windowcontrol: Database type mismatch for control (cost) in windowclass (item_stats_other)

I am not sure of the fix here. If you access the weapon straight from the module, it opens fine. But if you access it by going through the new Items list available with the newer FG versions, then it fails. It seems like when you open it from the new Items list, it wants to open it as if it were a magic item as opposed to a normal item. But if you copy the original record type (straight from the module) to the new Items list, it copies fine and can open. The records for normal items (weapons, armor, etc.) are different than for magic items. For magic items, the cost is a string. But for regular items (armor, weapons, etc.), the cost is a number. So I could change the cost to be a string, but then the normal weapon windows would stop working. If it stops working, then you will lose the ability to drag and drop a regular item (e.g., a longsword) onto a magic item (e.g., aftershock weapon +1) to create a concrete version of a magic item (e.g., an aftershock longsword +1.)

[Moon Wizard]

I believe this is fixed in v3.3.0 beta as well. There were a couple fields that I caught that varied between parsers, so I had to write a custom display field that could read either string or number . (Read only)

Cheers,
JPG

[spite]

It's currently still broken on test. Opening the "base' items like longsword, for example results in https://puu.sh/v9E4W/e157775768.jpg with a blank item if opened from the button on the right. Opening it from the library works correctly, however.
Magic items DO open correctly from the button on the right, though. It's only the ones on the left.

Crossposting this to the 3.3.0 thread also.

[crittman]

Ok, so one of my player has a couple of powers I cant figure out effect for. 1 is that he takes the damage aimed at another player(not too big an issue for me to change manually) 2 player is granted another healing surge. Any ideas? Again I can always do them manually just wanted to check if there was a way to automate them.

[spite]

There's no way to automatically redirect damage, so you'll need to remove and add the damage to the other player, or hope he calls out before you roll damage and then roll it on him instead.
As for the granted another healing surge, you mean another one to use temporarily, or spending another healing surge? If the former, you can set up a heal action that provides no healing but costs -1 healing surge. This will then add one surge back to them, lowering their spent healing surges by one.
If the power gives them a surge even if they are at maximum healing surges left though, this will not work. It will only return a spent healing surge.

What is the power name? I can have a look and see how it is worded to try help further.

[crittman]

The two powers in question are Martry's blessing(redirect damage) and the power connected to Aecris the magic weapon(gain healing surge)

[spite]

So for Aecris weapon, how I said should work fine. You can add a healing effect that looks like this https://puu.sh/vaxyG/2035984078.jpg where Str should be replaced with an attribute that adds no bonus. This is just to ensure there is no actual healing, but that the button will actually appear (it doesnt show if there is no value set). If you have no attribute without a bonus, just add an attribute, and put a minus afterwards equal to the attributes bonus, like this. If the player used dex and has a +5 dex mod, it'd show like this https://puu.sh/vaxKj/3374605e5c.jpg

For martyr's blessing, the player is just going to need to interject when they want to use it, hopefully before you roll damage. That way, you can drag the rolled attack onto the new target, see if it hits and then roll damage on him instead. Otherwise, you'll need to heal back the damage they took and apply it to the new target. No automation exists for taking the hit as that power is worded.

[crittman]

Thanks

[mrgrey]

I don't suppose there's an alternative to this that works on Linux, is there? Fantasy Grounds works fine on WINE, but unfortunately this program doesn't. I'm guessing there's a browser component to the program? If so, then apparently that component would have used libgluezilla on WINE, but that library has been discontinued...

[crittman]

I couldn't get WINE to install on OS x 10.8.5 Granted I am not a MAC guy.

[Moon Wizard]

spite,

The correct type for the "cost" field should be a "string" for all rulesets.

I don't know what changed in the parser, but the cost field in the base item record has been a "string" type for over a year in the 4E ruleset. I just checked backwards through all the revisions on the ruleset for the last 15 months. So, it seems like someone changed the parser to use numbers sometime recently perhaps?

I only added the number compatibility for reference items for modules built prior to that, which were not in the base item paths accessible to the item campaign list. If the records were moved over to be seen in the main campaign list, they'll need to be updated to use the correct data type.

Regards,
JPG

[valeros]

So sorry, I am still not understanding. For magic items which use a windowreference for a class of "item", the cost in this parser is a string. For mundane armor, weapons, and equipment, they use a windowreference for classes of "referencearmor", "referenceweapon", and "referenceequipment" respectively. Those windows all require that cost is a number, not a string. I tested and they all throw errors if the cost is a string. (So that is opening from the module itself, not the new Items list.) I do not believe I changed anything about the cost field in this parser in years. So the mundane items do not use the "item" class window by default with this parser. I would assume the only functionality lost if they were changed to use a class of "item" would be the drag and drop to create a specific magic item, but I am not sure if that is the only thing. But I would also assume that the "referencearmor", "referenceweapon", and "referenceequipment" windows were made different on purpose. I can change the parser to put them out with a class of "item" with the cost as a string instead if that is what they should be.

[Moon Wizard]

Let me break it down a bit to see if it helps.

Database Paths

The 4E ruleset only pulls item records for the master campaign list from "item" path (i.e. default campaign path), and "reference.items" path (i.e. defined as new path available for module items to be placed).

I'm not sure if the parser originally placed the items in the "reference.items" path, or if it was updated to do so. I assumed that it used a different path based on the older files that I have. Any records in these paths are assumed to use the standard format for items (used by all CoreRPG derived rulesets) that the "cost" field is a "string".

Database Fields

There is no built-in field that can read either strings or numbers to allow editing; it has to be either one or the other. Therefore, there is no easy way to make the item records both editable and support multiple field types. Plus, it complicates all the scripts that need to handle items across 4E and CoreRPG rulesets.

In order to support older modules that used "referenceweapon", "referencearmor" and "referencemagicitem" displays pointing to older data, as well as magic item lists that used older data, I enabled the "cost" information to be a read only non-database control to simply read a number or string without the ability to change the data.

Current Issues

I'm not sure if the current parser already used the "reference.items" path or if it was updated to use that path. As I mentioned, the "item" record has been the same for over a year, since the master list changes at least.

Moving Forward

Here are some options:

1) The parser can be updated to use "string" data type for item cost fields.
2) The modules can be processed after being created by the parser to convert the fields.
3) Someone can write the code for the 4E ruleset to handle all the item coding for making a complex control that can read either data type and write either data type, as well as handling in all the item scripts. This would also need to be maintained.

I would prefer that the parser matched up with all the other CoreRPG rulesets, so that a bunch of exception code doesn't need to be managed. Plus, I have higher priority items I have to work on at the moment that apply to commercial rulesets and/or affect multiple rulesets.

Regards,
JPG

[valeros]

I posted a new parser that outputs the mundane items twice. One output is formatted with cost as "string", the description as "flavor", and a "mitype" field. Those entries are under "reference.items" along with all the magic items. The other output is the same as before. Those entries are under "reference.mundaneitems". Going directly to the module works as before and references the old window types ("referencearmor", "referenceweapon", and "referenceequipment".) Going through the Items interface now also works.


I have higher priority items
Understood as 4E is not a money-maker for FG anymore. All the work you have done so far is greatly appreciated. Thank you very much for the help.

[spite]

Absolutely, thanks for the work you do put in Moon, and thanks valeros for keeping the parser working :)

[mrgrey]

I don't suppose there's an alternative to this that works on Linux, is there? Fantasy Grounds works fine on WINE, but unfortunately this program doesn't. I'm guessing there's a browser component to the program? If so, then apparently that component would have used libgluezilla on WINE, but that library has been discontinued...

Just repeating this question; I mean, I know I could just manually enter all the information in theory, but in practice that's just not going to happen - and I don't have access to a Windows computer to run the parser on.

[damned]

Hi mrgrey this is a tool written by valeros - it exists in the form you see here. Im sure you could get it to run in a WineSkin with some effort though.

[valeros]

I don't suppose there's an alternative to this that works on Linux, is there?

There is not alternative of which I am aware. This program uses .NET extensively. I think there is a push to get .NET on a lot more platforms (.NET CORE) including Linux.

[mrgrey]

The problem is, the web browser component of .Net doesn't work on Linux at all. If I had a copy of the source code, I could take a look at seeing if there's a way to do the same thing in Linux and get roughly the same output, but the only way to run this program on a Linux machine, until the Mono community come up with a replacement for libgluezilla, is with a VM running Windows.

[valeros]

the web browser component of .Net doesn't work on Linux at all

So does the program not start or does the browser portion just not work? I ask because it is possible to make an alternative where the entries are downloaded using HttpWebRequest instead. (Note that saying it is possible and I promise to do it are not the same.) But ripping the browser out of the program as a whole is a lot. It is really integrated into the program to the point of taking it out even if not used/needed would be a lot of effort and would require two versions of the program. Probably not willing to do that.

[mrgrey]

The program doesn't start, near as I can tell. It certainly doesn't open a window of any description. As soon as I use wine or mono to open it, I first receive an error saying that libgluezilla is missing, followed by unhandled NullReferenceExceptions due to System.Windows.Forms.WebBrowser not being available.

[valeros]

So another problem that I just found out that really makes removing the WebBrowser not an option is that the WebBrowser output changes the HTML. (It does things like changing the capitalization of tags and adding line breaks.) And the parser is extremely sensitive to the HTML being exactly as the WebBrowser provides. Sorry

[valeros]

the web browser component of .Net doesn't work on Linux at all

mrgrey, try the new executables attached on the first entry of this thread. The Compendium Reader and File Parser may work for you as I removed all references to a WebBrowser. One executable downloads entries to files, the other parses the files into modules.

[mrgrey]

Just started a download of all the backgrounds now. Depending on how long stuff takes, it may be tomorrow before I can give you any good feedback. The reader executable appears to work as intended at least.

[mrgrey]

I've just started running the file parser executable, and the text in the boxes doesn't have any line breaks in it, so I can only read the first bit of the text. I was at least able to read the contents of the first box by opening the executable in a text editor and searching for the right line of text, but that could probably do with being fixed. Also, how do I use the valid sources text files? Do I create a valid sources file and select that as one of the sources when selecting all the downloaded text files, or does the program just detect that the file exists in the same directory? Finally, what's the difference between the three different types of modules? Does it actually matter which of the three I use?

Oh, incidentally, while the reader executable works fine under wine, it crashes if I try to run it using mono instead - because linux uses a '/' instead of a '\' for file directories, it can't find the contents of the SearchResults directory. Doesn't make a massive amount of difference, in all honesty, but it seemed worth mentioning.

Edit: Ah, on rereading, the valid source text file just needs to be in the same directory.

[valeros]

1) I think a smarter person than me needs to answer about db.xml vs common.xml vs client.xml. My simplified version is:
db.xml: For DM. Cannot share.
client.xml: For Player. Can share. Each client needs file.
common.xml: Can share from host

Basically, pick db.xml

2) Sorry, the path issue is my fault for not following the .NET guidance. I will fix when I have time.

3) Seems like you figured out how to use "Valid Sources.txt"

Hopefully you now have some 4E modules for use

[damned]

I think you now should always use the common.xml option. The others are I think deprecated (but still work).

[valeros]

damned, Thanks, good to know. I had gone by this: https://www.fantasygrounds.com/forums/showthread.php?6446. I did not realize it was no longer valid. So then I should take the option away and always have the parser make a common.xml module, correct?

[damned]

Let me confirm that 100% before you make any changes.

[damned]

From Zacchaeus himself I got -


I think all three are still recognised by FG but client.xml is now deprecated in modules.

Db.xml defaults to read only (i.e. DM material such as a DM Guide or an adventure module) and common.xml defaults to player such as a player's handbook. Db.xml will give a red cross on the module list for the DM and common will not have either a red cross or a green tick (giving the DM the option to share or not).

So db.xml for DM only material and common.xml for player material and don't use client.xml.

So me personally Id lean towards common.xml unless there is stuff that you are parsing that is strictly GM only.

[DGM]

I posted a new parser that outputs the mundane items twice. One output is formatted with cost as "string", the description as "flavor", and a "mitype" field. Those entries are under "reference.items" along with all the magic items. The other output is the same as before. Those entries are under "reference.mundaneitems". Going directly to the module works as before and references the old window types ("referencearmor", "referenceweapon", and "referenceequipment".) Going through the Items interface now also works.


Understood as 4E is not a money-maker for FG anymore. All the work you have done so far is greatly appreciated. Thank you very much for the help.

Hi Valeros,

After updating to the latest version I received the error previously discussed.
So if I understand correctly after the 3.3.0 update reparsing the data should resolve this error?
Ruleset Error: windowcontrol: Database type mismatch for control (cost) in windowclass (item_stats_other)

Thanks for the great work on the parser :)

[Trenloe]

So me personally Id lean towards common.xml unless there is stuff that you are parsing that is strictly GM only.
There's a new player option in the Export window in FG. Do a test using that and see what it creates.

For GM material parsed, it should be db.xml.

[DGM]

To clear something up for people having problems with the following error.

@Ruleset Error: windowcontrol: Database type mismatch for control (cost) in windowclass (item_stats_other)

If you are receiving this error your 4e parsed data is using the wrong Database Fields.
As detailed by Moon Wizard (click here for info) (https://www.fantasygrounds.com/forums/showthread.php?17485-4E-Item-Parser&p=331095&viewfull=1#post331095)

How to fix
Step 1: Find if you still have your raw parsed data.
Have data:: Use the Compendium Reader and File Parser to re-parse your existing data.
Don't have data: Parse data from your subscription again.
Step 2: Praise Moon Wizard and valeros for being awesome.

[drakkan]

Can someone please explain to me step-by-step how this should work?
I am a dumb person :(

[drakkan]

*Mod Update*

Don't use obscenities on the site, either directed towards other people or not. You can express your frustrations in a better way and ask for assistance, but not like that.

[spite]

Removed quote with obscenities


Mate, Chill out. That sort of outburst is not needed.

What issue are you having, what ISN'T working how you intended?
Powers, Items are the only things that have functionality and work drag-and-drop, but everything else works as library reference modules. 4e won't auto-populate feat effects (no ruleset does this actually), and 4e doesn't autopopulate classes like 5e does. This is partly because there is no official 4e content licensed for FG use, so it is not in Smitework's interest to develop tools that they cannot even use or sell. However, the use of FG for combat tracking, power/effects tracking and character sheet use is still incredibly useful.

If you explain what you're hoping to achieve, perhaps I can help, or others on this forum can help you get to that point.

For example, I can get all these things to work as a player's module https://puu.sh/wtwlC/87a8c17a75.jpg and you can see what it produces for them. Are you having no luck reaching this point? Or simply unhappy with the final results

[drakkan]

Database Error: A XML parse error occurred processing file 4E Feats:client.xml - Error on line 26002: Error reading end tag.
Database Error: A XML parse error occurred processing file 4E Feats:client.xml - Error on line 26002: Error reading end tag.

[drakkan]

Or Or ORRRR !!! My favorite:
Database Error: A XML parse error occurred processing file 4E Feats:client.xml - Error on line 24072: Error reading Attributes.

[spite]

If you like, I can invite you to my discord, where real time chat might be of more use in helping you sort this out. https://discord.gg/uEp3MY

[drakkan]

I hope to achieve whatever 4EParser brags to achieve: get the <snip> content from DDI Compendium, make it a nice shiny module, then use it inside Fantasy Grounds to make things easier!

[ddavison]

Stop with the obscenities or we will be forced to kick you from the site.

[DGM]

I hope to achieve whatever 4EParser brags to achieve: get the <snip> content from DDI Compendium, make it a nice shiny module, then use it inside Fantasy Grounds to make things easier!

Please chill, I understand your frustration because it's not a click and go solution.
There are reasons why it's required to do it this way, mainly licensing and legal reasons as far as I understand.

The tool is made free of charge and it works quite awesomely when you understand how it works, there are some videos online teaching how to do it plus in the past couple of pages there is a lot of information on how to do this from scratch.

Spite even offered to help you out, I hope it all worked out for you in the end.
If not we can help you in a civil and relaxed manner.

[fantasmamore]

Hello all,

I use Fantasy Grounds on a mac through Steam and I parsed the ddi data just yesterday.

I used CompendiumFileParser.exe and I got the same error as Drakkan for my feats


Database Error: A XML parse error occurred processing file 4E Feats:db.xml - Error on line 24072: Error reading Attributes..

This is an error that pops up when I try to enable my Feats.mod from inside FG. Now, I have two xml files named "db". The first is automatically created inside a folder along with definition.xml and thumbnail.png but it doesn't have 24.000 lines. The other one is inside the .mod file and it is called .\db.xml but the specific line doesn't have anything out of the ordinary.

I used the parser again and this time I chose client.xml. I restarted FG with the new Feats.mod. This time it worked without an error! But... it only got 1361 out of the 3271 feats.

I then tried with the common.xml file. The same thing as with the client.xml happened (1361/3271).

In every case the parser window showed me this message:


Working, please wait
Processing Start Time = 7/3/2017 3:54:16 PM
00:00:00.25: Read File
NOT PARSED: feat: Just Sacrifice: <.</P>" target=_new>Dragon Magazine 381</A>, page(s) 93>
NOT PARSED: feat: Just Sacrifice: <.</P>>
3271 Total Entries
3271 Total Resulting Parsed Entries
Filtering
1316 Total Resulting Filtered Parsed Entries
Processing End Time = 7/3/2017 3:54:19 PM
Processing Total Time = 00:00:03

Done - Created folder: Feats

If .mod file creation fails, use FGPEMUtility to convert to .mod file

Now, if the problem is Dragon Magazine 381, I could exclude it from the list and solve the problem BUT when I create the Valid Sources.txt file with everything inside except DM381 it still downloads... 3271 feats. I don't know if the Valid Sources thing was supposed to work only with the 4eParser.exe (which I cannot use since I am on a mac).

I got a similar error for the line 20732 with the traps module.

Thank you in advance.

[fantasmamore]

OK, I am so sorry, I didn't realize that the Valid Sources.txt was filtering the parser, I thought that it was filtering the reader... Now I have all my feats. I will try to find a solution...

[fantasmamore]

So, I solved the problem and I write here what worked for me in case anyone else has the same problem.

Inside the Search Results folder (where you downloaded the parser and the reader) there is a feats3271.txt. I opened it, I found the feat that was causing the problem (Just Sacrifice) and I deleted the entire line. I then saved the .txt file, downloaded again the remaining 3270 feats through the reader and opened the parser. I choose client.xml but I don't know if that's relevant. My new feats module works great (although probably is missing this one feat)!
I will try to do the same thing for the traps, to see if there is an error somewhere and if there is, I am going to exclude that specific trap from the list.

[valeros]

There should have been three lines for "Just Sacrifice" with the last one being this:
<P class=publishedIn>Published in <A href="https://www.wizards.com/default.asp?x=dnd/drtoc/381" target=_new>Dragon Magazine 381</A>, page(s) 93 .</P>

That is why the parser did not like it. Not sure why your entry did not download correctly. Makes me wonder if other entries got messed up (besides the one other trap you mention.)

Also, if you want that one feat back (and assuming it will download correctly), you could run the program to download just that one entry. Then parse again selecting the file option and include the file with 3270 entries and the one with one entry and the parser will combine them.

[ddavison]

There should have been three lines for "Just Sacrifice" with the last one being this:
<P class=publishedIn>Published in <A href="https://www.wizards.com/default.asp?x=dnd/drtoc/381" target=_new>Dragon Magazine 381</A>, page(s) 93 .</P>

That is why the parser did not like it. Not sure why your entry did not download correctly. Makes me wonder if other entries got messed up (besides the one other trap you mention.)

Also, if you want that one feat back (and assuming it will download correctly), you could run the program to download just that one entry. Then parse again selecting the file option and include the file with 3270 entries and the one with one entry and the parser will combine them.

The majority of nearly all parsing issues are related to bad input data. Data pulled from webpages are not guaranteed to be XML compliant HTML and most browsers are set up to display even bad data. If the web content developer forgot to close out an html tag or something, the browsers do a fairly good job of simply ignoring that. In contrast, XML parsers are strict. The expectation was that XML would not be built to allow the same sort of lazy compliance that we see on the web since it has caused considerable problems. Therefore the programmers who built the various XML parsing libraries used in most programming languages forced it to have a strict format that doesn't try to fix or ignore problems as they appear, but instead throws a hard error back to the developer calling the parser.

That's a long way of saying that if the parsing is failing, check the data for the offending section and either remove that section or fix it. There is an XML validity checker for Notepad++ that I often use to help narrow down issue like this. If you save the file with an .xml extension and check the validity, it will at least tell you what line has the problem.

[tyene]

I feel as if this is going to be one of the dumbest questions ever asked, however... regarding step three of method 2 of the 4eparser 2017 0407. "Select Entries in Compendium then click button below." I just spent about 3 hours trying and failing to wrap my head around every possible understanding of "select" I could come up with and have failed at every turn. I cannot find anyway to select entries to be downloaded so that I may continue on with the act of parsing them. I drag, I highlight, I right click, I look for the secret handshake keyboard keys. I am defeated. If someone could save me from my ignorance I would be most thankful.

[spite]

Once you've signed into DDI on the first page, click "navigate to Compendium", then the browser should load to the compendium in the browser page.
Once that's loaded, you can search the compendium for any name, or group of entries (such as powers, or feats, or anything else). Once you've searched for them, click "Add Entries to Download" and it'll load the entries that are shown in the compendium page.
Once you have what you need, click step 5

[tyene]

Holy smokes. Thank you thank you thank you. I was stuck in this nightmare because I always hit "Launch Compendium" down in the bottom half like a dummy. Thanks a bunch.

[spite]

No worries! Glad to help where I can

[hullhawk]

Might seem like a stupid question but after you it the Number 5 button what do you do?

[spite]

Might seem like a stupid question but after you it the Number 5 button what do you do?

It should begin downloading what you have selected (this can take a while depending how many you have selected) and finish with creating the module. The module will be found inside the folder where the parser is located once it's done.
You should know it's going because the lower half of the window will be changing through the compendium selections every second or so.

[midomidi2013]

This looks good

[WitchRolina]

I'm having a bit of confusion as to how to do this. I'm following Method 2 on the tool, but I'm not sure if what I'm doing is right. Since the compendium needs query to bring up data, I'm not sure if I'm getting everything. Can someone point me out to a step by step guide to following this, or perhaps some tips in using D&D Insider's compendium? If there's a way to pull up all data that'd be preferable to running through the vowels and hoping it picked everything up...

Edit: Ah, forgot about the compendium reader. Might be able to figure this out. Sorry for the confusion, really new to all of this.

[spite]

Sing out if you do run into trouble!

[damned]

Id also start from the back of this thread as much of the stuff at the beginning of the thread has changed over time...

[Optimus21]

Hello all. I have been parsing 4e material with no problem using the '4eParser.exe' file. That is....until I got to powers. When I parse powers it creates the .txt file and then an .xml file that has zero data (It also makes a folder with a definition.xml and thumbnail.png). When I have done any other category it makes a .mod file no problem. Any ideas on what I am doing wrong? Thank you!

Edit, Added info: When I use Method 1 with the resulting text file I got using method 2, I get this error for each power entry: Failed to parse: Defy Death : also entry.Fields not populated

I have tried db.xml and common.xml. Again, thank you so much for help on this amazing tool!

[valeros]

The "Power Classes.txt" file must be in the same directory as the parser when parsing powers.

[Optimus21]

The "Power Classes.txt" file must be in the same directory as the parser when parsing powers.

Oh....my. Thank you. I apologize if that is written somewhere. I could not figure it out.

[SerpentineOwl]

This worked like a charm, thanks. I re-opened my compendium account yesterday, got all the files downloaded over the course of the day and overnight. This morning I was able to parse everything, create mods, and open them in Fantasy Grounds.

Some .txt downloads had to be edited where the closing paragraph tag shifted down a line, but the parser will tell you what items have errors. There were also two rituals that got nothing but the first and last line that caused a .mod import error. I found those items by looking at the compendium download log file I had saved and deleted them (Arcane Mark and Reliable Balance).

Valid Sources.txt works nicely. You can also run a parse on every downloaded text file. That will create a new text file with all the data that you can rename 'All Compendium', and you can use that one file to create .mod files based on Valid Sources.txt.

Now I just need to figure out what I want to import to a 4e campaign.

[LordEntrails]

SerpintineOwl, Welcome to the forums :) Even if it appears you've been around for awhile *g*

Glad things are working for you. Let us know if you have questions.

[Maldev]

4E Compendium powers parsing.....
Hi All.
I am still trying to get the 4e character powers from the Compendium into module form.
So far I have all the other entries imported via the parser into Module form.

However after trying to use the same method for the Powers entry it has taken some time for the download to run completely through.
1. I have a large text document from the Powers download and a message box came (see attach 1)
2. The Powers downloaded into a text document file. (attach 2)
3 I don't know how to proceed from here. I don't know which files to put into the parser.

Does anybody have experience with this.

Hopefully I am missing something obvious...

Cheers...

[Trenloe]

That message is not an error - it is just telling you to manually create the module if it fails. It's not telling you it fails.

Look for the directory it says it created - is there anything in there? Is there a .mod file created?

[Maldev]

Alas no, only the text and empty .XML files ��

[valeros]

Maldev, sorry, I had not looked at this thread for a while. I hope you figured out the problem since this is back from February.

The "Power Classes.txt" file must be in the same directory as the parser when parsing powers.

[Maldev]

No worries, it has been all sorted. Things are going well thanks. I have a new question posted earlier today " Is there a way to import edited monsters from Adventure tools?"
Any ideas?
Thanks

[DanMan]

Yo, trying to use the 4e item parser and it says i need to give it a module name and i dont know if i quite understand where to do so. I'm using windows 7 and the text does seem be oddly scaled when i run the program, might have something to do with it.

[dvm787s]

Um.

So.

Is there a quick fix if you were a little excited and parsed everything as a db.xml instead of common?

[damned]

welcome dvm787s

Have you tried just renaming the file to common.xml?

[dvm787s]

Thanks!

I'll give it a try when this next parse batch is done. Tried to get all the powers in one shot to run overnight, and somewhere in the rogue powers it stopped parsing and demanded my DDI login again. So now we're going to do the powers and items in small batches.

[andybrave]

Hi, please someone can explain why i cant edit modules created by parser? there is a way to edit? (red lock)
thx in advance

[Trenloe]

Hi, please someone can explain why i cant edit modules created by parser? there is a way to edit? (red lock)
thx in advance
This is fairly standard for Fantasy Grounds reference modules - so that you can't accidentally change the base, original record, for reference within a campaign.

You have a couple of options;
1) Make a copy of the record you want to edit. Drag/drop the record link within the campaign data list (buttons down the right of the desktop). This will create a copy of the record in the campaign, which you can edit.
2) If you're not worried about losing the original data in the campaign (you never edit the base module through the campaign, you just "edit" a local reference in the campaign itself), and you don't mind doing some XML editing - open up the FG module and look for static="true" entries within the XML elements - they are usually in high level headers. Remove this text completely. Save and re-package your FG module. All entries should then be editable within your campaign.

[Jackeyblob]

Hey, I downloaded the Parser and decided to use Method 2 (Log into the Compendium). I successfully log in but when I click Navigate to Compendium it keeps asking me to log into my DDI Account. Just wondering if anyone has had this problem or if there's something obvious I'm missing.

Edit: I suppose I should add. I have successfully logged into the Compendium via my browser and I have tried leaving Internet Explorer running with the Compendium on in the background as suggested earlier in the thread.

https://gyazo.com/3ba370ae73a0ebc0eded614e0118517c

https://gyazo.com/4873c6e5fb0ec31838da44304210c1ca

[Jackeyblob]

Just checking to see if this is still the place to ask help regarding the Parser?

[valeros]

I just posted a new version which fixed it for me. Hopefully works for you.

[Jackeyblob]

Hey, thanks a lot. Much appreciated.

[Rosesand]

Hi All,
Im trying to get this working and when I try and login to the Wizards account after clicking the DigitalRiver subscription I am getting a page timeout.
Does anyone know if you are still able to register and pay for an account?

[gamerhawaii]

I had the same issue almost a year ago. I emailed Wizards Customer Support for help getting a subscription and that worked.

[Rosesand]

Thanks gamerhawaii, Ill give that a go.

[Rosesand]

Hi All,
Im trying to get this working and when I try and login to the Wizards account after clicking the DigitalRiver subscription I am getting a page timeout.
Does anyone know if you are still able to register and pay for an account?

Update:
So after trying multiple browsers, networks, and computers, a clearing of the cookies/cache seemed to solve it and I was able to sign up.

I did, however, not tick the "I agree" on the page where you choose the currency, but that is unlikely to be related.

[nixxrite]

Hi All,

Searched the thread for tokens, not sure what the latest is but I'm trying to parse Kingdom of Ghouls with tokens. I've created the original folder, added the tokens and named folder and put the tokens in lower case in said folder e.g. Kingdom of Ghouls\tokens\Kingdom of Ghouls\great flameskull.png and so far all good. Tried recreating the mod and can't see the tokens. Tried zipping the output folder and changing the file to .mod but fantasy grounds doesn't recognise it.

Any suggestions on where I'm going wrong?

Thanks

[LordEntrails]

I don't know this parser, but I know with other parsers the tokens have to be; all lower cases, no spaces, and special characters replaced with an underscore.

Check the xml of the module and see if you can figure out what token name it is looking for.

[Trenloe]

Searched the thread for tokens, not sure what the latest is but I'm trying to parse Kingdom of Ghouls with tokens. I've created the original folder, added the tokens and named folder and put the tokens in lower case in said folder e.g. Kingdom of Ghouls\tokens\Kingdom of Ghouls\great flameskull.png and so far all good. Tried recreating the mod and can't see the tokens.
Instructions here: https://www.fantasygrounds.com/forums/showthread.php?17485-4E-Item-Parser&p=323781&viewfull=1#post323781 After adding the tokens you need to recreate the module file manually (see below).


Tried zipping the output folder and changing the file to .mod but fantasy grounds doesn't recognise it.
Make sure you compress using ZIP format, and make sure that you compress from within the module directory - not from outside of it. The base module files need to be at the root of the ZIP file. Then rename .ZIP to .mod - and make sure you have view file extensions turned on in Windows file explorer so you're properly renaming the file extension.

[valeros]

So I just checked and what you did seems correct. It expects that under your base "Kingdom of Ghouls" folder (which contains db.xml), there would be a folder called "tokens" and inside it a folder called "Kingdom of Ghouls". Then inside that folder the image would be "great flameskull.png".




I just tested by building a new module with the newest parser and then adding the token after. It worked as expected. You can look in the db.xml file to see what it expects. It should look something like this:
<token type="token">tokens/Kingdom of the Ghouls/great flameskull.png@Kingdom of the Ghouls</token>

So when the parser originally ran, it should have automatically put a "Kingdom of the Ghouls.mod" file (without your token) in the "modules" folder in Fantasy Grounds. Did you delete that one? Did you copy the new base "Kingdom of the Ghouls" folder over to the "modules" directory after you added the token?

(Oops, sorry, I did not see Trenloe's post before I posted. He got it. :))

[nixxrite]

Make sure you compress using ZIP format, and make sure that you compress from within the module directory - not from outside of it. The base module files need to be at the root of the ZIP file. Then rename .ZIP to .mod - and make sure you have view file extensions turned on in Windows file explorer so you're properly renaming the file extension.

Ahhh, my bad, I zipped from the top level which obviously adds another layer. Thanks all for the replies, really appreciated. :)

[Ryjulserenity]

Hi guys, was there an update for the parser for 4th edition within the last 3 months. I have the parser and i have parsed all the files except for the monsters. However when i click on the navigate to compendium button it sayd log into ddi but at the bottom of the parser i have already logged in any help would be appreciated im missing that one last module right now and cant get it to pick up my ddi no matter what i do. And yes my ddi is active and current.

Hi guys i solved the issue apparently there was an update i missed.

[Valyn Kenlyl]

So for some reason the parser, after working OK, now seems to refuse to create the .mod file. I get a folder after parse that only contains thumbnail.png and the definition.xml w/o a database.xml, as well as two txtfiles outside of the folder and a 0KB xml file. I tried to find the utility mentioned in the popup, be according to posts by Moon Wizard it has been deprecated...so I am not sure what is causing the parser to fail in .mod creation, nor what to do to finish the mod file. If the folder contained the db.xml I could jsut zip it up and rename it, but not sure if there is a way to convert the .txt file (that seems to have all of the data from the scrape) into the db file.

[valeros]

The .txt file has all the data downloaded, so you can use the program to parse that file. Select the option that lets you pick a file and select that file. It should create a module from that data.

[Rosesand]

Not sure if anyone is still paying attention here, but I received an email this morning from Wizards stating that the DDI service will no longer be available from 1 Jan 2020. No specific mention of the compendium, but refers to Silverlight platform.

Relevant email paste (emphasis theirs).

Dear DDI Subscriber,

We appreciate you being a subscriber for so many years! The sheer number of D&D encounters, characters, & creations this service has enabled is truly staggering and we are eternally grateful.

Due to the Silverlight platform no longer being supported by Microsoft, the Dungeons & Dragons Insider service will be ending effective December 31, 2019. All your characters and material will be unavailable starting on January 1, 2020.

[gamerhawaii]

I did not get that email, but it was expected. I am actually surprised they have left DDI running as long as they have. So what other RPG would be good that is tactical, combat-focused, and balanced like 4E?

[spite]

Well this isn't going to stop me playing. There are still offline options for both compendium and character builder.

If you're wanting newer tactical RPGs though, I recommend LANCER, Fragged Empire, and Unity RPG. All are fantastic

[gamerhawaii]

spite, thank you for the recommendations, I will definitely check them out.

What offline character builder do you use for 4E? We only play 4E in person and a great character builder is critical. I have looked before but never found another good one.

[spite]

If you look up CBloader and it's community-made content you have a working (for windows at least) offline character builder that can output character sheets for printing and contains all the content from the game officially released, as well as a bunch of community released homebrew addons that you can get. Things like Zeitgeist parts, war of the burning sky, eberron etc.

[Shimrath]

I am aware of CBLoader as an alternative to the Character Builder, but what online resource has all the data from the Compendium?

Losing access to the Compendium is kind of a big deal for those of us still running 4E. I was thinking of using 4EParser to scrape the entire Compendium, but i'm currently locked out of my account after the password reset from a week or two ago. Waiting for customer service to help.

Would love to know about an alternative!

Thanks!

[spite]

I've emailed you with some details on how to find and keep it updated! It's currently a community led endeavor

[Shimrath]

I was thinking of using 4EParser to scrape the entire Compendium, but i'm currently locked out of my account after the password reset from a week or two ago. Waiting for customer service to help.

Customer Service notified me that they have a high volume of requests currently, and so the clock is ticking on my ability to parse the Compendium. Has anyone already parsed it entirely that would be willing to share the MOD file(s) with me? Just in case time runs out. . . (I've been paying for DDI continuously, so i promise i'm not trying to steal it!)

[EnFaye]

Customer Service notified me that they have a high volume of requests currently, and so the clock is ticking on my ability to parse the Compendium. Has anyone already parsed it entirely that would be willing to share the MOD file(s) with me? Just in case time runs out. . . (I've been paying for DDI continuously, so i promise i'm not trying to steal it!)

Any chance you happened upon a MOD file(s) or finished parsing the compendium? Literally found out about FG two days ago and that DDI was going away last night. Dx I parsed everything but the Companions & Familiars, but I've also never done this and don't know if I did it right. x: Glad that I came across this thread when I did. @.@

[Crossems]

we can't distribute the mod files...but I'm curious if we could link the xml files that were parsed by the 4e parser, so that gm's can at least parse their own mods from them?

[Trenloe]

we can't distribute the mod files...but I'm curious if we could link the xml files that were parsed by the 4e parser, so that gm's can at least parse their own mods from them?
Linking the XML is basically exactly the same as distributing the mod files. It's the content itself that is copyright, not the way it's packaged.

[Crossems]

My thoughts are to completely parse the xml, and create mods that comply with the 4e SRD. Removing those terms that are copyrighted. The most work would probably be in rewriting the classes and races. I still run 4e Mods myself, and it's a bummer that new DM's have no way to parse the files to run their own content. There's got to be a solution some how.

Otherwise it's just time to get out the old elbow grease and create all your own content from the pdfs.

[Crossems]

Goodbye D&D Insiders
Due to the Silverlight platform no longer being supported by Microsoft, the Dungeons & Dragons Insider service will be ending effective December 31, 2019.

Seems that at least providing a linked resource to their DB or an API would be fair, or at least let someone else host one. unless Silverlight is just an excuse to shut down support for legacy products.

[Trenloe]

My thoughts are to completely parse the xml, and create mods that comply with the 4e SRD. Removing those terms that are copyrighted. The most work would probably be in rewriting the classes and races.
I can't see how this can be done within the 4E SRD and GSL (Game System License). The 4E SRD is not like other SRDs, it just allows specifically listed references to be used - i.e. referencing something in the allowed Core Rulebooks, not actually using the statistics. From the SRD: "You may use any 4E Reference in your Licensed Product, assuming the reader knows or can learn the meaning of that 4E Reference from the Core Rulebooks."

The SRD also states: "To remain in compliance with the GSL, you may not reproduce any running text, statistics block, or table from the Core Rulebooks, nor may you define, redefine, or alter the definition of any 4E Reference" So you can't even rewrite stuff in your own words.


... it's a bummer that new DM's have no way to parse the files to run their own content..
Yeah, it is a big shame. But with the Microsoft Silverlight going away, the main way to get access to repeatable formatted data to create your own (personal use) modules has gone away.


There's got to be a solution some how.
Wizards deliberately made the 4E GSL very restrictive, so I can't see a way to produce modules that can be distributed. Maybe someone will come up with another option for people who have access to legally owned data to create FG modules for their own use.