Appian Community
Site
Search
Sign In/Register
Site
Search
User
DISCUSS
LEARN
SUCCESS
SUPPORT
Documentation
AppMarket
More
Cancel
I'm looking for ...
State
Not Answered
Replies
8 replies
Subscribers
7 subscribers
Views
2520 views
Users
0 members are here
Share
More
Cancel
Related Discussions
Home
»
Discussions
»
General
we're currently doing a survey app that will input an excel file ->parse
Jess
over 11 years ago
we're currently doing a survey app that will input an excel file ->parse data using excel to cdt plugin, store data into 2 datastores and subprocess for the reporting. Here's the scenario/issues we're encountering:
1. Each file contains 1000+ rows and when we try to upload the file the ff error occured: "The number of tasks per node for "Current data" would exceed the limit of 1000." -.does it mean that we can't upload as many info more than 1000?
2. We then try to upload another excel file with 600+ rows only,yes it will upload but will take more than 30 mins (for the add new feature) but when we updated those 600+ info using the same concept, it would take us for about an hour. If this the case, how can we make it faster. This won't work with our requirement.Any suggestions?
TIA....
OriginalPostID-63749
OriginalPostID-63749
Discussion posts and replies are publicly visible
0
Siva
Certified Lead Developer
over 11 years ago
I think that smart service node is executed more than 1000 times which exceeds default maximum limit. In custom.properties file, there is an option to configure the Node Execution limit(MAX_NODE_INSTANCES). Here is the link to configure this
forum.appian.com/.../Configuring_the_Process_Engine_Servers
If you are hitting the node instance limit, see if there is any option to redesign your process to make it more scalable.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
Mike Cichy
Appian Employee
over 11 years ago
@Jessica, are you kicking off 1000+ subprocess nodes? I would definitely heed to Siva's advice. The limits are put in place there for a reason and if you are hitting any of them, it is usually a very strong indicator that design needs to revamped. If you already save the records in DB, why not just use a query rule with paging grid to retrieve the data for reporting purposes?
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
Jess
over 11 years ago
thanks for the info, yes i'm currently using a subprocess for the reporting,i need this because we need to provide graphical representation of data in different views,and we can't do this by just displaying data in paging grid..i tried to redesign my process and i was able to reduce 1hr+ into 30mins,for 1000+rows of data in the excel sheet by dividing the file into 2,and making 500rows/file per upload. Does this usually take this long?We need to upload about 181 excel sheet with 240,000 rows of data.what's the best way to handle this?
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
shelzle
over 11 years ago
Why not use a dedicated BI plattform? Appian is made for managing business processes. If necessary you can access this data from Appian and use in in processes.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
Mike Cichy
Appian Employee
over 11 years ago
I agree with Stefan on this. It means that you are going to have 240K processes just for reporting purposes. There are other tools and ways to display that data in a graphical way. Have you checked out the Chart Creator smart node available in the Components section? Load the data into a DB and create views to get your data.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
Karen Astley
Appian Employee
over 11 years ago
Hi Jessica - Mervin will contact you offline to understand this further and help you with some other options to meet the business requirements.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
Jess
over 11 years ago
if i used chart creator (via query rules),still it takes time..cause it will depend on how fast the data are being inserted to the datastore.In our case,it would take about 30 mins.+ for every 999 data inserted.@karen,thanks, I'm still waiting for mervin's reply.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
0
shelzle
over 11 years ago
I think the idea is to load the data outside appian directly into a DB and use the chart creator to report to the users.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel