Apatar.com
|
Log In
Log In
close x
Login
Password
Remember me
Forgot Your Password?
Create Account
close x
First Name
Last Name
E-mail
Telephone
Message
Home
DataMaps
Downloads
Community
Documentation/Wiki
Report Bugs
Forums
Mailing Lists
ETL News
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
Apatar Community Forums Forum Index
->
Help
Post a reply
Username
Subject
Message body
Emoticons
View more Emoticons
Font colour:
Default
Dark Red
Red
Orange
Brown
Yellow
Green
Olive
Cyan
Blue
Dark Blue
Indigo
Violet
White
Black
Font size:
Font size
Tiny
Small
Normal
Large
Huge
Close Tags
[quote="stangerb"]I have and MS SQL component as my source, attached to the Transform component, which is in turn connected to a Salesforce component. On the Salesforce component, I have configured as Insert Mode, with the "Clear the selected table before any data written" box checked. When I run the project however, Apatar is not clearing the data in the Salesforce table. Any thoughts?[/quote]
Options
HTML is
OFF
BBCode
is
ON
Smilies are
ON
Disable BBCode in this post
Disable Smilies in this post
All times are GMT
Jump to:
Select a forum
Apatar Open Source
----------------
Announcements
Installation and Upgrade
Help
General Discussion
Feature Requests
Downloads
Development
APPLICATION INTEGRATION AND CONNECTORS
----------------
New Connector Requests
Connectors Discussion
DataMaps
Topic review
<table border="0" cellpadding="3" cellspacing="1" width="100%" class="forumline"> <tr> <th class="thCornerL" width="22%" height="26">Author</th> <th class="thCornerR">Message</th> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>sumitvakil</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Sat Oct 08, 2011 10:20 pm<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">So my workaround for this problem was to stop using Apatar's delete functionality. In my case, it is sufficient for me to just delete the existing data and load fresh data. <br /> <br />For the delete, I am successfully using the command line version of Salesforce's Data Loader. The data loader first retrieves all the ids for the tables I want to clear. Then it deletes records with these ids. It works great! <br /> <br />Once the data loader finishes, I run Apatar to insert new data. <br /> <br />Sumit</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>sumitvakil</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Thu Oct 06, 2011 6:49 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">This is still a problem. I set up a very simple experiment. I created a clean org, and a single custom object with one text field only. Then I loaded 5,000 records. Next, I tried to insert 150 new records using the Apatar salesforce connector (Insert option), making sure to select the clear table before Insert option. Note that my data source is an Access database, but that shouldn't matter. <br /> <br />Only 2,000 records get deleted. It seems that a loop runs 10 times, deleting 200 records during each loop. I see a "Records Processed" message count up from 0 to 11. <br /> <br />Edit: Forgot to mention that this is a problem with deletes only. I have successfully used the Salesforce connector to upload 45,000 records. <br /> <br />The error console is as follows: <br /> <br />********************************* <br />Start date Wed Oct 05 23:43:11 PDT 2011 <br />Version Apatar_v1.12.23 <br />JRE Version 1.7.0 <br />JRE Vendor Oracle Corporation <br />Encoding Cp1252 <br />log4j.configuration = `null` <br />Start Reading from MasterOutput <br />Start Reading from MasterOutput <br />creating errors dump file <br />C:\src\ETL\Apatar\test\errors\errors20111005234528.csv <br />dump file `C:\src\ETL\Apatar\test\errors\errors20111005234528.csv` created <br />Exception in thread "AWT-EventQueue-0" java.lang.StringIndexOutOfBoundsException: String index out of range: -1 <br /> at java.lang.String.checkBounds(String.java:406) <br /> at java.lang.String.<init>(String.java:578) <br /> at com.apatar.ui.JErrorDebugDialog.readFromFile(JErrorDebugDialog.java:192) <br /> at com.apatar.ui.JErrorDebugDialog.createDialog(JErrorDebugDialog.java:111) <br /> at com.apatar.ui.JErrorDebugDialog.<init>(JErrorDebugDialog.java:78) <br /> at com.apatar.ui.Actions$12.actionPerformed(Actions.java:325) <br /> at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2018) <br /> at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2341) <br /> at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:402) <br /> at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259) <br /> at javax.swing.AbstractButton.doClick(AbstractButton.java:376) <br /> at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:833) <br /> at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:877) <br /> at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289) <br /> at java.awt.Component.processMouseEvent(Component.java:6504) <br /> at javax.swing.JComponent.processMouseEvent(JComponent.java:3321) <br /> at java.awt.Component.processEvent(Component.java:6269) <br /> at java.awt.Container.processEvent(Container.java:2229) <br /> at java.awt.Component.dispatchEventImpl(Component.java:4860) <br /> at java.awt.Container.dispatchEventImpl(Container.java:2287) <br /> at java.awt.Component.dispatchEvent(Component.java:4686) <br /> at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4832) <br /> at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4492) <br /> at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4422) <br /> at java.awt.Container.dispatchEventImpl(Container.java:2273) <br /> at java.awt.Window.dispatchEventImpl(Window.java:2713) <br /> at java.awt.Component.dispatchEvent(Component.java:4686) <br /> at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:707) <br /> at java.awt.EventQueue.access$000(EventQueue.java:101) <br /> at java.awt.EventQueue$3.run(EventQueue.java:666) <br /> at java.awt.EventQueue$3.run(EventQueue.java:664) <br /> at java.security.AccessController.doPrivileged(Native Method) <br /> at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76) <br /> at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:87) <br /> at java.awt.EventQueue$4.run(EventQueue.java:680) <br /> at java.awt.EventQueue$4.run(EventQueue.java:678) <br /> at java.security.AccessController.doPrivileged(Native Method) <br /> at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76) <br /> at java.awt.EventQueue.dispatchEvent(EventQueue.java:677) <br /> at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:211) <br /> at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:128) <br /> at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:117) <br /> at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:113) <br /> at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:105) <br /> at java.awt.EventDispatchThread.run(EventDispatchThread.java:90) <br /> <br /> <br />Thanks, <br /> <br />Sumit</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>caos14159</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Thu Jul 14, 2011 5:33 pm<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Hello, I am having this same problem, was there ever a solution?</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>rtest</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Wed Nov 18, 2009 9:34 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Hello, <br /> <br />can you share your custom obj original data in xls sheet with me. <br /> <br />Thanks, <br />Rohit Sharma</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>Sergei</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Wed Nov 18, 2009 9:02 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody"></span><table width="90%" cellspacing="1" cellpadding="3" border="0" align="center"><tr> <td><span class="genmed"><b>stangerb wrote:</b></span></td> </tr> <tr> <td class="quote">Rohit, <br /> <br />Thanks for the reply. For some reason, I did not get a notification that you had replied. <br /> <br />There are no triggers attached to the table. It's just a raw data table. <br /> <br />Unfortunately I don't have this in a dev database. <br /> <br />I'm at a total loss. Is there anyone I can contact at apatar?</td> </tr></table><span class="postbody"> <br /> <br />Hi <span style="font-weight: bold">stangerb</span>, <br /> <br />What Apatar version do you use? What SF table do you try to clear? Do you get any errors in Debug -Show error? <br /> <br />Regards, <br />Sergei</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>stangerb</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Tue Nov 17, 2009 11:14 pm<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Rohit, <br /> <br />Thanks for the reply. For some reason, I did not get a notification that you had replied. <br /> <br />There are no triggers attached to the table. It's just a raw data table. <br /> <br />Unfortunately I don't have this in a dev database. <br /> <br />I'm at a total loss. Is there anyone I can contact at apatar?</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>rtest</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Thu Nov 12, 2009 6:54 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">It shows that Apatar - delete functionality is working. <br /> <br />You need to check in your org : if any trigger does exist on any other object which maintain lookup/master detail relationship with your custom object. <br /> <br />By Default SFDC delete the data in a batch size of "200" in a single process. <br /> <br />That could be issue with Apatar if they have set certain limit while deleting for salesforce (but I don't think so). Coz I was able to delete more than 15000 of record via enabling that checkbox {Clear previous data}. <br /> <br />is this possible for you to share with me your sfdc login detail (if its your dev org) and mapper file.</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>stangerb</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Tue Nov 10, 2009 10:50 pm<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Temp Folder Deleted. <br /> <br />Count in SFDC before job runs 5996 <br /> <br />MS SQL 5993 records <br />Transform Object 5993 records <br />SFDC 9989 records <br /> <br />5996+5993-9989=2000 records deleted. <br /> <br />I changed the MS SQL query to only return one record. I ran the project several times and was able to finally get all of the records to be deleted incrementally as below: <br /> <br />1st Run Start 9989 records End 7990 records = 1999 record net change = 2000 records deleted - 1 Added <br /> <br />2nd Run Start 7990 records End 5991 records = 1999 record net change = 2000 records deleted - 1 Added <br /> <br />3rd Run Start 5991 records End 3992 records = 1999 record net change = 2000 records deleted - 1 Added <br /> <br />4th Run Start 5992 records End 1993 records = 1999 record net change = 2000 records deleted - 1 Added <br /> <br />5th Run Start 1993 records End 1 record = 1992 record net change = 1993 records deleted - 1 Added <br /> <br />Is there some sort of delete governor in Apatar or Salesforce limiting deletes to 2000 records? <br /> <br />I also zipped & sent the two log files you requested to the email address you gave me. <br /> <br />Thanks for the help.</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>rtest</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Tue Nov 10, 2009 5:08 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Hello, <br /> <br /> <br />For pt: <br /> <br /></span><table width="90%" cellspacing="1" cellpadding="3" border="0" align="center"><tr> <td><span class="genmed"><b>Quote:</b></span></td> </tr> <tr> <td class="quote">It's not that records aren't deleted. Sometimes a few are deleted. Sometimes none are deleted. If I run it several times </td> </tr></table><span class="postbody"> <br /> <br />Comment: Before executing this mapper file next time please delete the "Temp" folder from directory where Apatar installed and see the result now. <br /> <br />For pt: <br /> <br /></span><table width="90%" cellspacing="1" cellpadding="3" border="0" align="center"><tr> <td><span class="genmed"><b>Quote:</b></span></td> </tr> <tr> <td class="quote">I'd copy the whole debug log, but every time I try to select the text in the debug window, the cursor almost instantly returns to the bottom & I can't select or copy.</td> </tr></table><span class="postbody"> <br /> <br />Comment: No need to do this copy -paste from output console. You simply check your debug_output.txt and error_output.txt <br />(if possible then can share with me via email <a href="mailto:rohan62003@gmail.com">rohan62003@gmail.com</a>) <br /> <br />In general: <br />Before executing mapper, check how many records you have in this custom object in SFDC. <br /> <br />Hope this time, it should work. If not then can possible for you to share mapper with me on above e-mail Id. <br /> <br />Thanks, <br />Rohit Sharma <br /> <br /> <br /> <br /> <br />Thanks, <br />Rohit Sharma</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>stangerb</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Tue Nov 10, 2009 12:16 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Rohit, <br /> <br />Thanks for the reply. I'm running the job under my Sys Admin username in SF, and can delete records from the SFDC. There are no triggers or validations on the custom object I am inserting records into. <br /> <br />It's not that records aren't deleted. Sometimes a few are deleted. Sometimes none are deleted. If I run it several times <br /> <br />Preview Results on the Transform object yields expected results - 5977 records & no errors in the log. <br /> <br />However, on the SFDC object, the debug log says 8024 records were processed (no errors) but 7983 records show up in the preview window. <br /> <br />I'd copy the whole debug log, but every time I try to select the text in the debug window, the cursor almost instantly returns to the bottom & I can't select or copy. <br /> <br />Really frustrated. Any thoughts?</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row1"><span class="name"><a name=""></a><b>rtest</b></span></td> <td class="row1" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Mon Nov 09, 2009 9:55 am<span class="gen"> </span> Post subject: </span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">Hello, <br /> <br />Can you please share what object in SFDC using as TARGET. <br /> <br />Need to do some debugging: <br /> <br />1) Have you tried to delete a single record manually using SFDC "UI". <br /> <br /><span style="text-decoration: underline"><span style="font-style: italic">There could be a chance of having any work flow/trigger/validation rule or might be not having right for deleting the records set by Admin either on object level or user that you using in the mapper file do not have right for deletion.</span> <br /> </span> <br />2) if you are able to delete the record from SFDC UI using same user then go to your mapper file and do "Preview Result" on <br /> <br />* Transform <br />* SFDC (Object) <br /> <br />individually. And check in parallel your error output file and see what error message you are getting. <br /> <br /> <br />Thanks, <br />Rohit Sharma</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> <tr> <td width="22%" align="left" valign="top" class="row2"><span class="name"><a name=""></a><b>stangerb</b></span></td> <td class="row2" height="28" valign="top"><table width="100%" border="0" cellspacing="0" cellpadding="0"> <tr> <td width="100%"><img src="templates/subSilver/images/icon_minipost.gif" width="12" height="9" alt="Post" title="Post" border="0" /><span class="postdetails">Posted: Sat Nov 07, 2009 12:09 am<span class="gen"> </span> Post subject: Apatar not clearing data in Salesforce table</span></td> </tr> <tr> <td colspan="2"><hr /></td> </tr> <tr> <td colspan="2"><span class="postbody">I have and MS SQL component as my source, attached to the Transform component, which is in turn connected to a Salesforce component. On the Salesforce component, I have configured as Insert Mode, with the "Clear the selected table before any data written" box checked. <br /> <br />When I run the project however, Apatar is not clearing the data in the Salesforce table. <br /> <br />Any thoughts?</span></td> </tr> </table></td> </tr> <tr> <td colspan="2" height="1" class="spaceRow"><img src="templates/subSilver/images/spacer.gif" alt="" width="1" height="1" /></td> </tr> </table>
Powered by
phpBB
© 2001, 2005 phpBB Group
Terms and Conditions
Privacy Policy
Contact Info
Comments and Suggestions
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in